-- Logs begin at Sat 2022-02-12 03:26:58 UTC, end at Sat 2022-02-12 04:39:10 UTC. -- Feb 12 04:10:11.566603 dv-cinder-828696-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 12 04:10:11.575905 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 04:10:11 2022] *** Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: nodename: dv-cinder-828696-3-iscsi Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: machine: x86_64 Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: clock source: unix Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: pcre jit disabled Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: detected number of CPU cores: 4 Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: current working directory: / Feb 12 04:10:11.577384 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: detected binary path: /usr/bin/uwsgi-core Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: your processes number limit is 47680 Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: your memory page size is 4096 bytes Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: detected max file descriptor number: 2048 Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: lock engine: pthread robust mutexes Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: thunder lock: enabled Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 12 04:10:11.577957 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 04:10:11.624513 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: Python main interpreter initialized at 0x55b3c9ac09c0 Feb 12 04:10:11.624513 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: python threads support enabled Feb 12 04:10:11.624513 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: your server socket listen backlog is limited to 100 connections Feb 12 04:10:11.624513 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: your mercy for graceful operations on workers is 90 seconds Feb 12 04:10:11.624836 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 04:10:11.624911 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: *** Operational MODE: preforking *** Feb 12 04:10:11.625161 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: *** uWSGI is running in multiple interpreter mode *** Feb 12 04:10:11.625161 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: spawned uWSGI master process (pid: 102417) Feb 12 04:10:11.625365 dv-cinder-828696-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 12 04:10:11.625882 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: spawned uWSGI worker 1 (pid: 102418, cores: 1) Feb 12 04:10:11.626208 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: spawned uWSGI worker 2 (pid: 102419, cores: 1) Feb 12 04:10:11.626365 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 04:10:13.400386 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:10:13.400386 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: from cryptography.utils import int_from_bytes Feb 12 04:10:13.401046 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:10:13.401046 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: from cryptography.utils import int_from_bytes Feb 12 04:10:13.401729 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:10:13.401729 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: from cryptography.utils import int_from_bytes Feb 12 04:10:13.402201 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:10:13.402201 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: from cryptography.utils import int_from_bytes Feb 12 04:10:15.943004 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:10:15.943559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:10:15.943742 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:10:15.944100 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:10:15.944352 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:10:15.944731 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.945053 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.945170 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:10:15.945559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.945654 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:10:15.945745 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.945951 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:10:15.946047 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.946313 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.946425 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:10:15.946563 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:10:15.946667 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.946937 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947038 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947260 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947354 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947518 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947617 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947834 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.947926 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948155 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-3-iscsi {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948294 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948476 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948571 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948783 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.948879 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949091 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949178 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949432 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949524 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949697 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.949793 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.950013 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.950110 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.950869 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.950965 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-3-iscsi {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.951195 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.951403 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.951545 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.951848 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.951981 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952156 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952251 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952467 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952563 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952789 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.952886 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953112 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953219 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953431 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953638 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953742 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.953952 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954036 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954258 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954343 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954569 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954656 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.954903 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955038 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-3-iscsi {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955216 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955343 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955528 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955652 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955847 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.955963 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956157 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956374 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956481 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956688 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956793 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.956994 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957164 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-3-iscsi {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957331 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957509 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957651 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957824 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.957956 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958138 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958283 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958553 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958656 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958867 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.958952 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959171 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959267 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959500 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959603 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959805 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.959895 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960114 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960209 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960432 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960521 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960737 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.960834 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961041 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961128 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961299 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961396 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961618 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961710 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.961942 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962037 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962260 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962345 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962579 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962682 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962828 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.962920 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963077 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963190 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963396 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963495 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963716 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.963802 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964024 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964115 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964332 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964490 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964636 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964728 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964904 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.964995 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.965156 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.965249 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.965502 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.965595 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.965823 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.966453 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.966682 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.966839 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.966995 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967089 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967306 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967406 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967618 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967707 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.967923 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968036 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968231 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968394 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968540 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968625 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968851 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.968935 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969155 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969247 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969503 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969628 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969825 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.969930 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.970132 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.970242 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.970447 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.970545 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971024 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971124 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971334 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971420 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971640 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971725 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.971946 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972031 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972264 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972380 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972589 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972674 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972892 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.972981 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973142 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973234 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973471 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973558 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973779 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.973871 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974096 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974188 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974403 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974490 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974708 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.974804 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975014 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975106 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975296 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975379 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975603 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975696 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975908 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.975997 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976213 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976323 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976518 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976614 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976824 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.976957 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977128 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977213 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977455 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977554 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977759 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.977842 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978064 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978154 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978372 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978482 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978683 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978777 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.978989 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979073 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979296 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979381 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979604 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979722 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.979911 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980027 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980216 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980364 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980522 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980620 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980823 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.980919 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981137 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981224 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981484 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981577 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981790 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.981885 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982100 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982196 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982407 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982499 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982712 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.982798 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983018 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983111 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983322 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983415 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983628 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983721 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.983931 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984018 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984237 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984329 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984538 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984630 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984842 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.984967 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985144 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985231 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985470 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985564 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985775 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.985861 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986077 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986169 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986379 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986478 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986678 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986763 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.986982 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987066 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987289 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987382 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987595 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987680 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987900 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.987989 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988204 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988300 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988511 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988602 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988813 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.988897 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.989132 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.989226 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.989477 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.989574 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.989791 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.989887 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.990097 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.990190 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.990405 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.990491 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.990729 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:10:15.990826 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991040 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991131 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991355 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991447 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991680 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991765 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.991990 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992075 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992300 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992385 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992611 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992707 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.992925 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993010 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993246 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993358 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993587 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993678 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993904 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.993987 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994215 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994307 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994544 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994704 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994888 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.994980 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995137 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995228 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995452 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995544 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995769 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.995852 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996079 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996164 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996395 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996492 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996715 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.996800 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997025 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997201 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997395 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997497 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997714 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.997806 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998026 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998110 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998336 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998432 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998647 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998740 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.998967 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999051 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999303 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999388 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999615 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999699 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:15.999936 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000033 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000243 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000328 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000553 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000637 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000865 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.000960 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001172 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001257 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001507 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001592 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001838 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.001921 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002152 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002238 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002465 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002547 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002776 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.002869 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003086 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003169 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003400 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003491 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003711 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.003802 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004022 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004107 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004328 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004420 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004633 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004729 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.004939 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005035 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005248 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005354 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005572 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005669 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005884 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.005967 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006199 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006290 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006502 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006592 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006807 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.006896 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007114 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007238 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007421 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007506 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007725 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.007815 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008032 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008115 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008337 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008424 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008648 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008733 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.008956 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009093 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009261 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009367 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009595 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009688 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.009919 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010052 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010207 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010293 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010512 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010610 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010817 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.010969 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011121 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011212 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011425 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011508 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011732 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.011827 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.012042 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.012136 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.012347 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.012430 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.012666 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.013346 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.013511 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.013606 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.013821 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.013906 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014137 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014222 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014451 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014538 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014765 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.014851 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015081 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015174 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015400 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015484 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015712 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.015796 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016012 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016103 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016319 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016411 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016622 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016707 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.016924 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017010 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017226 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017370 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017556 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017653 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017857 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.017949 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018161 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018246 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018462 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018619 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018765 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.018850 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019065 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019149 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019383 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019479 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019686 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019771 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.019987 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020078 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020291 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020393 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020592 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020677 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020898 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.020983 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021205 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021355 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021562 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021650 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021874 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.021968 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022181 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022273 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022488 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022579 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022793 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.022878 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023103 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023194 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023417 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023509 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023727 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.023813 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024034 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024120 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024343 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024428 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024662 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024745 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.024971 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025075 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025300 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025388 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025614 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025711 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.025930 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026016 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026236 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026326 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026547 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026643 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026849 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.026933 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027161 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027252 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027479 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027572 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027791 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.027875 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028113 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028197 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028474 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028566 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028784 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.028867 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029096 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029179 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029426 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029523 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029737 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.029831 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030045 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030131 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030354 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030490 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030669 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030806 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.030978 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031121 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031295 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031427 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031601 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031731 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.031911 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032038 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032218 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032348 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032528 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032655 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032829 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.032956 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033143 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033300 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033486 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033622 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033801 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.033938 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034113 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034242 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034423 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034551 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034739 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.034875 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035042 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035181 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035348 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035477 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035657 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035795 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.035961 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036091 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036265 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036395 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036573 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036714 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.036885 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037015 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037192 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037349 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037524 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037654 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037827 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.037963 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038133 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038261 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038436 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038567 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038737 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.038867 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039038 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039186 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039346 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039487 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039656 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039787 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.039963 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040090 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040276 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040405 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040585 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040715 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.040887 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041040 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041174 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041333 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041525 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041610 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041823 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.041919 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042126 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042211 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042429 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042520 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042731 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.042834 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043044 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043135 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043351 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043438 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043657 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.043813 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.044471 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.044562 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.044790 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.044875 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045096 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045188 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045429 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045526 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045736 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.045822 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046043 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046129 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046360 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046579 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046664 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046742 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.046967 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047054 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047276 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047367 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047583 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047715 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047890 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.047978 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048196 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048278 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048516 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048617 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048823 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.048921 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049130 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049221 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049460 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049557 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049766 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.049851 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050074 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050158 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050387 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050480 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050712 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.050954 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051046 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051287 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051416 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051604 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051690 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051910 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.051993 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.052228 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.052325 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.052544 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.052627 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.052872 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053106 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053251 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053459 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053599 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053773 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.053908 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054093 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054226 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054416 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054727 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.054855 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055037 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055166 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055343 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055481 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055648 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055783 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.055949 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056087 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056258 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056400 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056562 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056701 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056863 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.056993 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057165 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057327 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057491 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057635 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057797 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.057926 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058099 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058226 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058461 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058599 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058727 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.058859 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.059012 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.059148 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.059318 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.059461 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.059693 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.060306 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.060488 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.060629 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.060795 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.060925 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061112 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061243 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061448 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061597 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061773 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.061916 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062090 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062241 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062397 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062535 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062705 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.062841 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063012 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063145 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063336 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063472 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063645 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063784 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.063937 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064077 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064240 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064376 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064548 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064693 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064855 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.064985 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065158 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065315 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065492 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065622 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065802 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.065933 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066112 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066243 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066421 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066550 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066724 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.066867 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067032 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067161 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067333 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067467 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067645 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067780 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.067952 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068094 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068254 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068385 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068556 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068697 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068859 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.068994 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069164 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069355 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069495 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069639 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069768 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.069900 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070070 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070200 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070384 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070521 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070687 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070819 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.070989 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071118 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071289 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071420 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071592 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071725 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.071896 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072032 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072198 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072334 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072514 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072646 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072821 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.072950 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073122 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073256 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073446 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073576 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073757 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.073902 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074057 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074192 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074357 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074487 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074662 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074799 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.074976 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075104 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075306 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075442 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075613 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075754 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.075922 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076052 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076224 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076354 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076527 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076665 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076828 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.076958 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077134 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077263 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077444 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077584 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077752 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.077891 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078055 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078188 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078359 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078488 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078657 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078784 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.078961 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079097 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079271 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079408 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079570 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079702 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.079871 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080008 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080171 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080301 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080475 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080604 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080782 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.080922 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081105 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081234 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081450 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081583 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081757 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.081896 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082068 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082197 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082370 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082499 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082678 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082817 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.082988 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083124 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083290 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083419 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083604 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083750 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.083918 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084047 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084226 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084356 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084530 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084667 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084832 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.084971 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085148 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085336 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085482 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085617 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085767 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.085896 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086077 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086209 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086391 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086523 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086697 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086827 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.086998 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087131 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087303 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087439 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087610 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087753 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.087917 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088047 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088222 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088353 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088528 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088657 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088837 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.088975 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089145 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089302 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089474 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089604 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089783 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.089928 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090092 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090177 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090394 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090477 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090701 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.090794 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091033 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091126 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091336 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091421 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091646 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091738 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.091950 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092034 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092252 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092337 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092560 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092650 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092859 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.092949 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093165 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093250 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093490 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093578 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093814 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.093898 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094128 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094213 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094435 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094521 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094751 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.094879 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.095060 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.095161 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.095373 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.095474 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.095680 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096034 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096247 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096523 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096628 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096711 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.096951 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097050 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097259 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097402 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097590 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097686 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.097901 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098000 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098202 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098310 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098503 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098600 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098811 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.098908 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099132 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099238 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099434 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099531 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099737 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.099841 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100039 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100137 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100358 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100456 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100658 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100766 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.100977 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101075 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101338 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101447 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101649 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101746 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.101961 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102067 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102267 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102376 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102592 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102689 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.102899 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103003 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103222 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103318 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103597 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103767 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.103922 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104035 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104223 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104309 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104534 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104632 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104841 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.104933 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105159 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105244 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105503 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105600 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105813 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.105899 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.106124 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.106228 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.106442 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107097 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107256 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107356 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107576 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107662 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107890 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.107974 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108224 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108356 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108533 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108666 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108851 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.108937 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109162 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109249 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109513 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109603 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109841 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.109917 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110152 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110277 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110452 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110538 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110760 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.110871 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111064 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111196 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111367 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111509 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111676 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.111832 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112041 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112172 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112306 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112448 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112583 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112751 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.112862 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113064 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113166 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113394 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113473 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113710 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.113936 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.114134 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.114336 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.114548 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.114763 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.114981 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.115191 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.115410 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.115622 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.115830 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.116046 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.116273 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.116496 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.116704 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.116914 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.117135 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.117394 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.117616 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.117819 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.118029 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.118240 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.118449 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.118670 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.118895 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.119111 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.119323 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.119529 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.119748 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.119962 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.120210 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.120439 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.120661 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.120882 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.121117 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.121387 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.121601 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.121821 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.122031 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.122790 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.123023 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.123234 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.123437 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.123660 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.123864 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.124076 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.124302 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.124512 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.124722 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.124943 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.125148 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.125384 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.125667 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.125879 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.126088 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.126296 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.126296 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.126724 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.126941 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127151 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127301 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127394 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127476 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127564 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127645 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127724 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127802 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.127918 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128073 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128233 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128378 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128468 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128582 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128669 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128766 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128859 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.128944 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129023 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129101 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129179 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129257 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129386 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129508 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129594 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129673 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129758 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129846 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.129926 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130004 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130004 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130146 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130146 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130347 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130446 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130537 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130625 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130711 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130792 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.130944 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131026 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131112 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131197 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131321 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131408 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131495 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131575 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131665 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131746 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131825 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131910 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.131995 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132081 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132161 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132239 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132324 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132410 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132490 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132575 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132654 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132741 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132883 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.132979 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133197 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133306 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133537 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133622 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133855 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.133953 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134171 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134293 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134483 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134570 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134796 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.134884 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135105 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135321 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135408 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135656 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135749 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.135975 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136061 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136291 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136377 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136606 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136766 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.136924 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137011 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137237 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137414 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137578 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137666 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.137918 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138005 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138231 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138316 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138546 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138668 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138873 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.138969 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139179 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139273 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139495 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139589 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139811 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.139906 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140128 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140223 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140442 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140528 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140752 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.140837 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141065 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141182 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141402 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141493 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141716 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.141801 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142025 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142113 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142339 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142426 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142651 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142737 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.142968 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143063 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143283 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143378 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143596 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143711 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.143916 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144047 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144230 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144351 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144544 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144651 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.144854 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145063 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145156 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145410 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145501 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145745 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.145832 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146069 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146155 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146392 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146476 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146707 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.146794 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147024 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147109 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147346 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147477 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147651 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147876 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.147961 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148194 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148290 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148532 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148620 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148836 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.148979 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.149154 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.149397 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.149614 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.149751 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.149885 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150025 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150159 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150293 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150435 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150569 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150715 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.150887 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151023 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151239 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151377 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151691 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.151886 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152016 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152214 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152346 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152518 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152658 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152829 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.152958 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.153139 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.153269 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.153497 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.153719 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.153804 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154069 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154156 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154389 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154474 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154707 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.154790 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155012 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155099 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155325 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155410 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155634 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155720 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.155940 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156028 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156251 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156342 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156554 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156638 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156871 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.156956 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157173 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157260 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157503 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157601 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157810 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.157893 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158119 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158203 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158424 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158518 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158729 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.158814 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159032 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159117 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159335 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159427 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159644 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159728 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.159949 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160033 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160257 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160350 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160558 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160654 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160870 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.160967 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161171 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161263 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161501 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161635 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161807 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.161893 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162120 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162207 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162435 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162521 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162743 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.162828 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163056 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163148 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163361 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163452 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163675 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163766 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.163984 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164471 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164471 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164690 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164690 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164890 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.164979 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165064 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165240 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165467 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165563 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165799 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.165888 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166121 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166207 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166453 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166539 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166784 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.166878 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167092 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167178 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167399 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167500 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167705 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.167792 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168029 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168266 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168358 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168611 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168699 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.168935 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.169557 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.169791 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.169880 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170103 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170191 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170413 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170499 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170722 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.170816 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171034 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171121 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171343 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171429 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171651 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171738 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.171959 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172045 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172272 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172362 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172588 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172684 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172903 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.172997 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173219 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173322 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173556 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173650 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173874 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.173960 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174184 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174275 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174494 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174591 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174804 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.174941 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175113 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175204 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175429 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175516 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175756 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.175843 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176069 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176161 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176375 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176462 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176693 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.176784 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177009 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177095 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177413 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177515 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177732 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.177825 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178040 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178132 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178360 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178444 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178680 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178765 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.178990 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179127 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179297 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179382 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179607 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179722 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.179935 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180028 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180271 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180357 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180599 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180689 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.180923 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181009 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181229 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181332 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181644 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181866 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.181953 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182176 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182261 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182503 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182594 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182835 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.182922 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183147 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183234 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183468 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183561 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183785 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.183870 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184105 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184190 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184413 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184506 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184783 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.184894 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185099 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185185 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185433 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185538 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185742 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.185830 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186073 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186166 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186384 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186480 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186696 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.186782 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187008 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187094 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187319 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187405 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187626 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187718 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.187934 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188021 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188257 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188350 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188572 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188658 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188874 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.188959 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189196 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189301 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189538 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189639 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189851 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.189944 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190164 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190250 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190472 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190562 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190783 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.190880 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191097 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191189 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191413 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191499 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191722 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.191822 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192033 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192122 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192347 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192432 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192663 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192758 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.192982 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193112 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193322 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193414 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193650 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193738 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.193961 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194046 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194283 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194369 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194598 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194693 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.194916 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.195057 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.195235 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.195370 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.195584 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.195892 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.196068 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.196233 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.196374 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.196568 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.196699 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:10:16.196901 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.197237 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.197619 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.197942 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.198295 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.198628 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.198948 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.199265 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.199576 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:10:16.199824 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:10:16.223164 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_db.sqlalchemy.engines [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.224265 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_db.sqlalchemy.engines [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.285910 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.context [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),341d3641-d12d-47f5-8051-421ca6730917(cell1) {{(pid=102418) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 04:10:16.286941 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.context [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),341d3641-d12d-47f5-8051-421ca6730917(cell1) {{(pid=102419) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 04:10:16.290281 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_concurrency.lockutils [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:10:16.291121 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:10:16.291895 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_concurrency.lockutils [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:10:16.292699 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_concurrency.lockutils [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:10:16.292788 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:10:16.293546 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:10:16.294682 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_concurrency.lockutils [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:10:16.295497 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:10:16.306566 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_db.sqlalchemy.engines [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.307743 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_db.sqlalchemy.engines [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.310853 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_db.sqlalchemy.engines [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.314489 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_db.sqlalchemy.engines [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.467029 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG oslo_db.sqlalchemy.engines [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.469740 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_db.sqlalchemy.engines [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:10:16.887491 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: WARNING keystonemiddleware.auth_token [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:10:16.894165 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: WARNING keystonemiddleware.auth_token [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:10:16.914843 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: WARNING keystonemiddleware.auth_token [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:10:16.921963 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: WARNING keystonemiddleware.auth_token [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:10:17.230434 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: WARNING keystonemiddleware.auth_token [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:10:17.235727 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: WARNING keystonemiddleware.auth_token [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:10:17.240848 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3c9ac09c0 pid: 102418 (default app) Feb 12 04:10:17.242920 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:10:17.244072 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001693 Feb 12 04:10:17.244475 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Sat Feb 12 04:10:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:10:17.258515 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: WARNING keystonemiddleware.auth_token [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:10:17.264380 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: WARNING keystonemiddleware.auth_token [None req-130587e8-3ecd-4f56-a942-3adc56f80919 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:10:17.269476 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3c9ac09c0 pid: 102419 (default app) Feb 12 04:11:39.705977 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:39.709585 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Feb 12 04:11:39.709585 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:40.135285 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-f4affdfc-fbe4-4000-8d40-4b883e129bf5 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:40.165113 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-f4affdfc-fbe4-4000-8d40-4b883e129bf5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451188 Feb 12 04:11:40.165821 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 04:11:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:11:42.432599 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:42.434193 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-4942a5b9-8676-4225-a865-09ff8fa50bca None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Feb 12 04:11:42.434579 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:42.496725 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-64bb8944-eda3-4a14-9c16-fdb38c0a39de admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:42.516004 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:11:42.516004 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:11:42.610203 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-64bb8944-eda3-4a14-9c16-fdb38c0a39de admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.169787 Feb 12 04:11:42.610763 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:11:42.828049 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-13946165-cc2f-4daf-bcb3-63938a827c9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:42.830502 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:11:42.830502 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: warnings.warn(msg) Feb 12 04:11:42.937534 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-13946165-cc2f-4daf-bcb3-63938a827c9d admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.318853 Feb 12 04:11:42.938361 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 04:11:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:11:45.208431 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-64bb8944-eda3-4a14-9c16-fdb38c0a39de admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:45.209497 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-64bb8944-eda3-4a14-9c16-fdb38c0a39de admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Feb 12 04:11:45.209898 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:45.321262 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-24740166-9f32-4e20-b942-e37fda2830a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:45.339861 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:11:45.339861 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: warnings.warn(msg) Feb 12 04:11:45.442699 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-24740166-9f32-4e20-b942-e37fda2830a2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226255 Feb 12 04:11:45.451579 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 04:11:45.456472 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b19b520c-6d53-45d8-8e1a-3ffbca7d4805 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:45.458024 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:11:45.458024 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:11:45.581980 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b19b520c-6d53-45d8-8e1a-3ffbca7d4805 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128426 Feb 12 04:11:45.583019 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 04:11:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:11:47.856074 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-24740166-9f32-4e20-b942-e37fda2830a2 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:47.857154 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-24740166-9f32-4e20-b942-e37fda2830a2 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005031 Feb 12 04:11:47.857868 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:47.914800 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b3141da7-0ed0-43a6-af69-0d18023f131b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "name": "ds1G"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:48.034276 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b3141da7-0ed0-43a6-af69-0d18023f131b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.169991 Feb 12 04:11:48.034854 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 04:11:48.047582 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-d4b454fa-494c-4a68-9a26-5ffcc99d633b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:48.099272 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-d4b454fa-494c-4a68-9a26-5ffcc99d633b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055377 Feb 12 04:11:48.100114 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 04:11:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:11:50.378227 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b3141da7-0ed0-43a6-af69-0d18023f131b admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:50.379534 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b3141da7-0ed0-43a6-af69-0d18023f131b admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001748 Feb 12 04:11:50.379943 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:50.440082 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-87a5153c-f9db-4fee-a8d4-001865932492 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:50.503447 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-87a5153c-f9db-4fee-a8d4-001865932492 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117005 Feb 12 04:11:50.504057 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:11:50.516608 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-2ce68c27-f0c2-4d93-b8b3-a52738fa787b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:50.602419 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-2ce68c27-f0c2-4d93-b8b3-a52738fa787b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089574 Feb 12 04:11:50.603062 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 04:11:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:11:52.869415 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-87a5153c-f9db-4fee-a8d4-001865932492 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:52.870485 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-87a5153c-f9db-4fee-a8d4-001865932492 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Feb 12 04:11:52.871177 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:52.929637 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:53.004422 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127599 Feb 12 04:11:53.005326 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 04:11:53.017779 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-e00bed11-2e32-47c9-829b-e01c8e6bb186 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:53.105967 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-e00bed11-2e32-47c9-829b-e01c8e6bb186 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091851 Feb 12 04:11:53.106762 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 04:11:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:11:55.383471 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:55.384471 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Feb 12 04:11:55.385031 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:55.443236 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-ebd8c354-1d6e-49cc-8f1f-e31cd896b09b admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:55.469901 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-ebd8c354-1d6e-49cc-8f1f-e31cd896b09b admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078819 Feb 12 04:11:55.470444 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 04:11:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:11:57.774026 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:11:57.775030 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-b4368f97-e886-4a84-9087-aadecf043b21 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Feb 12 04:11:57.775699 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:11:57.833417 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-28ac20b7-78eb-49ef-9020-87535d450deb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:57.895799 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-28ac20b7-78eb-49ef-9020-87535d450deb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.114283 Feb 12 04:11:57.896626 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:11:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:11:57.912893 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-2b21125e-979c-414e-9155-70f54c5c93e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:11:58.023516 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-2b21125e-979c-414e-9155-70f54c5c93e1 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117338 Feb 12 04:11:58.024391 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 04:11:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:12:00.778559 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-28ac20b7-78eb-49ef-9020-87535d450deb admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:00.779613 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-28ac20b7-78eb-49ef-9020-87535d450deb admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 12 04:12:00.780042 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:00.843437 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fabdcb1d-5902-4a8b-a7b0-9dd66d53aca3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:00.958959 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fabdcb1d-5902-4a8b-a7b0-9dd66d53aca3 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.172154 Feb 12 04:12:00.960222 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:12:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:00.972033 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-85e36a67-c048-40d9-9e59-813a9a2ff84a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:01.054253 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-85e36a67-c048-40d9-9e59-813a9a2ff84a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085796 Feb 12 04:12:01.054844 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 04:12:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:12:03.769552 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fabdcb1d-5902-4a8b-a7b0-9dd66d53aca3 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:03.771409 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fabdcb1d-5902-4a8b-a7b0-9dd66d53aca3 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002383 Feb 12 04:12:03.772238 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:12:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:03.832220 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-bc2c180a-c837-4409-b5b4-90757f45278a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:03.901041 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-bc2c180a-c837-4409-b5b4-90757f45278a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.121990 Feb 12 04:12:03.902137 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:12:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:03.914079 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-e04f32d9-92f8-426b-a2ca-a809c4cbe7bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:04.007681 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-e04f32d9-92f8-426b-a2ca-a809c4cbe7bc admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097224 Feb 12 04:12:04.008273 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 04:12:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:12:06.289588 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-bc2c180a-c837-4409-b5b4-90757f45278a admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:06.290691 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-bc2c180a-c837-4409-b5b4-90757f45278a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Feb 12 04:12:06.291108 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:12:06.355468 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-582a1c7a-cf93-4c38-94bb-ef8716d55e6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:06.436895 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-582a1c7a-cf93-4c38-94bb-ef8716d55e6f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139013 Feb 12 04:12:06.437874 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:12:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:06.449852 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-f6932533-ba56-4b12-a6da-d43ca9793048 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:06.531605 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-f6932533-ba56-4b12-a6da-d43ca9793048 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085565 Feb 12 04:12:06.532600 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 04:12:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:12:08.835869 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-582a1c7a-cf93-4c38-94bb-ef8716d55e6f admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:08.836869 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-582a1c7a-cf93-4c38-94bb-ef8716d55e6f admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 12 04:12:08.837295 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:12:08.910553 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "swap": 0}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:08.999449 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.151930 Feb 12 04:12:09.000525 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 04:12:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:09.014163 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-1925a00b-57ff-49fc-a4ce-da85f6825a84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:09.111459 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-1925a00b-57ff-49fc-a4ce-da85f6825a84 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103083 Feb 12 04:12:09.112043 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 04:12:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:12:32.802705 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:32.803708 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Feb 12 04:12:32.804100 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:12:32.861093 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-102b17b8-956e-4a6d-82e1-a9ca6212ef44 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:32.877542 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-102b17b8-956e-4a6d-82e1-a9ca6212ef44 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066994 Feb 12 04:12:32.878072 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 04:12:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:34.229956 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:34.230990 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-9bab8f4a-a435-408c-bbbe-5966d307a281 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001959 Feb 12 04:12:34.231388 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:34.417790 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-6dbe0d5b-21b9-4c1c-893c-2bfe3a53d7d7 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:34.423212 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.wsgi [None req-6dbe0d5b-21b9-4c1c-893c-2bfe3a53d7d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 12 04:12:34.423776 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-6dbe0d5b-21b9-4c1c-893c-2bfe3a53d7d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:34.424568 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-6dbe0d5b-21b9-4c1c-893c-2bfe3a53d7d7 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057376 Feb 12 04:12:34.425071 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 04:12:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:34.434259 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-954f71f7-e81f-45ec-86a7-e473863ea65d admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:34.454264 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-954f71f7-e81f-45ec-86a7-e473863ea65d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023429 Feb 12 04:12:34.462245 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:34.472230 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fe80966c-bbe4-437f-bc8f-ef8597ce5f42 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:34.493530 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fe80966c-bbe4-437f-bc8f-ef8597ce5f42 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024742 Feb 12 04:12:34.494047 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:34.502968 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-9421413d-7b75-4a66-9b38-0ba153d5e797 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:34.508290 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.wsgi [None req-9421413d-7b75-4a66-9b38-0ba153d5e797 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 12 04:12:34.508838 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-9421413d-7b75-4a66-9b38-0ba153d5e797 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:34.509641 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-9421413d-7b75-4a66-9b38-0ba153d5e797 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010134 Feb 12 04:12:34.510124 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 04:12:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 12 04:12:35.762801 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fe80966c-bbe4-437f-bc8f-ef8597ce5f42 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:35.763831 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fe80966c-bbe4-437f-bc8f-ef8597ce5f42 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Feb 12 04:12:35.764224 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:35.952651 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-8b81bba4-fab4-4086-b70f-cc41c76e70e4 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:35.958297 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.wsgi [None req-8b81bba4-fab4-4086-b70f-cc41c76e70e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 12 04:12:35.958848 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-8b81bba4-fab4-4086-b70f-cc41c76e70e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:35.959629 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-8b81bba4-fab4-4086-b70f-cc41c76e70e4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.056445 Feb 12 04:12:35.960113 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 04:12:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:35.970274 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-2568c3bd-ac18-4405-9307-788415668e10 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:35.985602 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-2568c3bd-ac18-4405-9307-788415668e10 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019065 Feb 12 04:12:35.986046 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:35.995224 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-68081cbf-89d7-43c6-bef2-aee7a0ffdf31 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:36.008377 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-68081cbf-89d7-43c6-bef2-aee7a0ffdf31 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016561 Feb 12 04:12:36.008901 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:36.018994 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-0f258cae-3f35-492b-a943-de53f0844c55 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:36.025575 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.wsgi [None req-0f258cae-3f35-492b-a943-de53f0844c55 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 12 04:12:36.026808 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-0f258cae-3f35-492b-a943-de53f0844c55 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:36.027596 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-0f258cae-3f35-492b-a943-de53f0844c55 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013256 Feb 12 04:12:36.028110 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 04:12:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:37.301637 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-68081cbf-89d7-43c6-bef2-aee7a0ffdf31 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:37.302642 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-68081cbf-89d7-43c6-bef2-aee7a0ffdf31 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 12 04:12:37.303043 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:37.491079 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fe6bfa2e-d0d1-4d3d-8f2a-664f999d16a4 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:37.496510 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.wsgi [None req-fe6bfa2e-d0d1-4d3d-8f2a-664f999d16a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 12 04:12:37.497060 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fe6bfa2e-d0d1-4d3d-8f2a-664f999d16a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102419) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:37.497886 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fe6bfa2e-d0d1-4d3d-8f2a-664f999d16a4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057420 Feb 12 04:12:37.498384 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:12:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:37.507569 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-d14c304c-e132-497a-9e85-faf800691b2f admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:37.522183 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-d14c304c-e132-497a-9e85-faf800691b2f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018075 Feb 12 04:12:37.522647 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:37.532517 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:37.545772 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017028 Feb 12 04:12:37.546283 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 04:12:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:12:37.555181 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-5fd05b40-a683-44af-b15c-2015235660f3 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:37.560228 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.wsgi [None req-5fd05b40-a683-44af-b15c-2015235660f3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 12 04:12:37.560783 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-5fd05b40-a683-44af-b15c-2015235660f3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:12:37.561590 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-5fd05b40-a683-44af-b15c-2015235660f3 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009823 Feb 12 04:12:37.562075 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:12:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:38.855081 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:38.856139 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 12 04:12:38.856538 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:39.049928 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-a1b72c64-ed7d-4ba9-9ee0-27680de589ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:39.117126 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-a1b72c64-ed7d-4ba9-9ee0-27680de589ee admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.122753 Feb 12 04:12:39.117618 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 04:12:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:40.381685 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:40.382715 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Feb 12 04:12:40.383139 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:40.575092 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-953698b5-7f35-4db8-b74e-a1ff90e64af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:40.643220 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-953698b5-7f35-4db8-b74e-a1ff90e64af4 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.119127 Feb 12 04:12:40.643769 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 04:12:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:41.914823 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:41.915863 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Feb 12 04:12:41.916291 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:42.109555 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-a106a8f8-d1f4-4490-952d-1848c4ec5af2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:42.204174 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-a106a8f8-d1f4-4490-952d-1848c4ec5af2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.149030 Feb 12 04:12:42.204646 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 04:12:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:43.460236 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:43.461241 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Feb 12 04:12:43.461692 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:43.647645 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-f9b4ffe1-d3fb-439d-b62f-1219db5e5aa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:12:43.701322 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-f9b4ffe1-d3fb-439d-b62f-1219db5e5aa5 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.103224 Feb 12 04:12:43.701870 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 04:12:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:12:44.954323 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:44.955317 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 12 04:12:44.955709 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:12:45.141948 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-935cdd6b-857d-458a-9cf5-313ee4c1e540 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:12:45.160508 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-935cdd6b-857d-458a-9cf5-313ee4c1e540 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068870 Feb 12 04:12:45.161036 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Sat Feb 12 04:12:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:13:30.106587 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.107595 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-fd6c7b0f-2847-4b3b-8a9a-25bc2ae1c49c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Feb 12 04:13:30.107998 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:13:30.163144 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-1ac7262a-08f6-4dc2-9f96-bb03da070b23 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.182321 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-1ac7262a-08f6-4dc2-9f96-bb03da070b23 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068313 Feb 12 04:13:30.182853 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:13:30.204881 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-0adffdc5-7cc7-49da-bf98-11e13f354454 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.213205 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-0adffdc5-7cc7-49da-bf98-11e13f354454 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011932 Feb 12 04:13:30.213789 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:13:30.225565 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-944d16f1-cd10-47e2-9ac0-c358f0b80ff1 admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.233953 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-944d16f1-cd10-47e2-9ac0-c358f0b80ff1 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012393 Feb 12 04:13:30.234538 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:13:30.246057 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-9c949398-5fbe-4549-8102-97d38b6c7efc admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.253815 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-9c949398-5fbe-4549-8102-97d38b6c7efc admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011409 Feb 12 04:13:30.254343 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:13:30.266192 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:13:30.273663 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011064 Feb 12 04:13:30.274211 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Sat Feb 12 04:13:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:15:27.356701 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-c5cc74c5-974e-42bf-b882-75cbb5bb983f tempest-verify_tempest_config-1912923532 tempest-verify_tempest_config-1912923532-project] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:15:27.358688 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-c5cc74c5-974e-42bf-b882-75cbb5bb983f tempest-verify_tempest_config-1912923532 tempest-verify_tempest_config-1912923532-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107560 Feb 12 04:15:27.359226 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 34/69] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 04:15:27 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:16:56.114665 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:16:56.115663 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Feb 12 04:16:56.116063 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 36/70] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:16:56.367425 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:16:56.368599 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:56.368599 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:16:56.370138 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:16:56.370575 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:16:56.371444 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:16:56.371871 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:16:56.404723 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-d5cafc89-79ce-425e-8d29-e3bec17b4914 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149145 Feb 12 04:16:56.405266 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 35/71] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:16:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:16:57.699418 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:16:57.700421 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Feb 12 04:16:57.700980 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 37/72] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:16:57.890541 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:16:57.891712 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:57.891712 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:16:57.893219 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:16:57.893684 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:16:57.894470 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:16:57.894890 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:16:57.913443 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-6072c975-c26d-4992-9fe3-8ba815561a75 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073736 Feb 12 04:16:57.913934 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 36/73] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:16:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:17:09.637737 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:17:09.638755 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Feb 12 04:17:09.639158 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 38/74] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:17:09.826491 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:17:09.827636 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:17:09.827636 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:17:09.829151 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:17:09.829597 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:17:09.830379 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:17:09.830830 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:17:09.855301 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-10e1b768-ffea-4683-bf4d-18a7cf2a3cf8 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079567 Feb 12 04:17:09.855765 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 37/75] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:17:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:17:11.124369 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: DEBUG nova.api.openstack.wsgi [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] Calling method '>' {{(pid=102418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:17:11.125399 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: INFO nova.api.openstack.requestlog [None req-11ea5929-49a8-4d28-8738-6478bda18fff admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Feb 12 04:17:11.125800 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: [pid: 102418|app: 0|req: 39/76] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 04:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:17:11.315255 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG nova.api.openstack.wsgi [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] Calling method '>' {{(pid=102419) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:17:11.316405 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:17:11.316405 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: warnings.warn(msg) Feb 12 04:17:11.317988 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:17:11.318425 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:17:11.319224 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:17:11.319647 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: DEBUG oslo_concurrency.lockutils [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102419) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:17:11.340829 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: INFO nova.api.openstack.requestlog [None req-af6e5aed-63be-49b1-a19e-ccfc2bd3d848 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076228 Feb 12 04:17:11.341901 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: [pid: 102419|app: 0|req: 38/77] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 04:17:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:18:10.598598 dv-cinder-828696-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 12 04:18:10.599121 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: Sat Feb 12 04:18:10 2022 - graceful shutdown triggered... Feb 12 04:18:10.599544 dv-cinder-828696-3-iscsi devstack@n-api.service[102418]: Gracefully killing worker 1 (pid: 102418)... Feb 12 04:18:10.599908 dv-cinder-828696-3-iscsi devstack@n-api.service[102419]: Gracefully killing worker 2 (pid: 102419)... Feb 12 04:18:11.599609 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: worker 1 buried after 1 seconds Feb 12 04:18:11.600072 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: worker 2 buried after 1 seconds Feb 12 04:18:11.600072 dv-cinder-828696-3-iscsi devstack@n-api.service[102417]: goodbye to uWSGI. Feb 12 04:18:11.601182 dv-cinder-828696-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 12 04:18:11.601774 dv-cinder-828696-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 12 04:18:11.604836 dv-cinder-828696-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 12 04:18:11.616422 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 04:18:11 2022] *** Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: nodename: dv-cinder-828696-3-iscsi Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: machine: x86_64 Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: clock source: unix Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: pcre jit disabled Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: detected number of CPU cores: 4 Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: current working directory: / Feb 12 04:18:11.618505 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: detected binary path: /usr/bin/uwsgi-core Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: your processes number limit is 47680 Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: your memory page size is 4096 bytes Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: detected max file descriptor number: 2048 Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: lock engine: pthread robust mutexes Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: thunder lock: enabled Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 12 04:18:11.619259 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 04:18:11.666561 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: Python main interpreter initialized at 0x5572292989c0 Feb 12 04:18:11.666561 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: python threads support enabled Feb 12 04:18:11.666561 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: your server socket listen backlog is limited to 100 connections Feb 12 04:18:11.666561 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: your mercy for graceful operations on workers is 90 seconds Feb 12 04:18:11.666998 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 04:18:11.666998 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: *** Operational MODE: preforking *** Feb 12 04:18:11.667260 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: *** uWSGI is running in multiple interpreter mode *** Feb 12 04:18:11.667260 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: spawned uWSGI master process (pid: 116735) Feb 12 04:18:11.667465 dv-cinder-828696-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 12 04:18:11.668365 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: spawned uWSGI worker 1 (pid: 116750, cores: 1) Feb 12 04:18:11.668365 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: spawned uWSGI worker 2 (pid: 116751, cores: 1) Feb 12 04:18:11.668535 dv-cinder-828696-3-iscsi devstack@n-api.service[116735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 04:18:13.610029 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:18:13.610029 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: from cryptography.utils import int_from_bytes Feb 12 04:18:13.610733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:18:13.610733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: from cryptography.utils import int_from_bytes Feb 12 04:18:13.647080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:18:13.647080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: from cryptography.utils import int_from_bytes Feb 12 04:18:13.647750 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:18:13.647750 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: from cryptography.utils import int_from_bytes Feb 12 04:18:16.057897 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:18:16.058470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:18:16.058751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:18:16.059039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:18:16.059296 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:18:16.059690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.060022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.060347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.060670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.061003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.061340 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.061675 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.062000 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.062334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.062596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.062921 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.063249 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-3-iscsi {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.063574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.063883 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.064198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.064521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.064827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.065166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.065493 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.066001 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.067507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.067507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.067507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.067507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.067931 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.068011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.068316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.068630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.068948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.069262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.069695 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-3-iscsi {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.070014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.070345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.070652 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.071070 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.071436 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.071749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.072071 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.072411 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.072723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.073056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.073413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.073745 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.074063 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.074371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.075213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.075213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.075440 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.075655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.075892 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.076144 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.076459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.076788 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.077124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.077467 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.077723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.077977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.078300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.078617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.078929 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.079306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.079619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.080796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.080796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.080796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.080796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.081120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.081453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.081777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.082105 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.082417 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.082740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.083153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.083405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.083721 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.084097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.084390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.084891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.085396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.085891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.086375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.086869 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.087350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.087987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.088541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.088815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.089074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.089411 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.089726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.090055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.090420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.090669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.090982 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.091291 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.091643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.091902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.092266 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.092580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.092890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.093218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.093548 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.093862 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.094172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.094505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.094837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.095151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.095459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.095771 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.096085 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.096418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.096733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.097044 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.097400 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.097712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.098022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.098345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.098659 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.098970 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.099296 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.099603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.099912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.100236 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.100547 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.100857 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.101165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.101504 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.101814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.102377 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.103280 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.103595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.103904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.104230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.104561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.104881 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.105242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.105531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.105857 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.106204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.106542 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.106894 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.107215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.107556 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.107890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.108211 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.108527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.108846 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.109175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.109516 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.109833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.110149 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.110470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.110792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.111126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.111444 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.111760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.112081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.112393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.112712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.113043 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.113404 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.113720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.114066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.114414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.114734 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.115097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.115387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.115700 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.116013 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.116358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.116647 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.116988 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.117326 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.117649 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.117962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.118870 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.119186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.119508 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.119835 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.120161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.120474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.120795 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.121111 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.121456 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.121773 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.122087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.122399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.122709 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.123019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.123328 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.123638 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.123946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.124270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.124601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.124912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.125250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.125586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.125899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.126212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.126541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.126833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.127184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.127524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.127759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.128088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.128401 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.128712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.129040 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.129373 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.129685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.130004 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.130319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.130634 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.130949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.131277 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.131593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.131911 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.132254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.132593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.132904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.133234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.133587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.133970 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.134282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.134597 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.134973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.135207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.135514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.135824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.136133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.136441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.136807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.137046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.137468 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.137801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.137985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.138294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.138600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.138908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.139253 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.139561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.139905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.140309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.140561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.140890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.141205 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.141550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.141864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.142178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.142491 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.142805 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.143128 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.143442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.143766 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.144078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.144403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.144716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.145116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.145367 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.145691 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.146034 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.146372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.146855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.147016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.147339 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.147636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.147972 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.148259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.148560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.148872 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.149193 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.150074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.150426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.150706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.151034 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.151525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.151885 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.152445 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.153007 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.153629 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.154229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.154790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.155351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.155959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.156467 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.157020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.157620 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.158121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.158347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.158605 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.158973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.159180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.159498 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.159811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.161891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.162191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.162408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.162615 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.162925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.163491 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.163663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.163933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.164242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.164550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.164908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.165823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.166359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.166542 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.166762 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.167334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.167487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.167727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.168056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.168470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.168630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.169013 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.172145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.173304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.173304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.173304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.173304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.173879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.174020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.174271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.174598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.174926 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.175251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.175591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.175927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.176247 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.176589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.176904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.180170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.181420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.182416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.182416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.182416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.182818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.182818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.183109 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.183437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.183747 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.184092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.184425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.184798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.185074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.185405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.185739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.186048 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.186358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.186665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.186977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.187288 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.187595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.187908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.188224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.188535 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.188846 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.189153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.189489 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.189822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.190397 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.190397 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.190697 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.190992 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.191371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.191694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.192299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.192626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.192923 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.193250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.193579 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.193886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.194196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.194509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.194893 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.195149 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.195509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.195826 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.196174 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.196490 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.196847 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.197157 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.197493 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.197807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.198142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.198464 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.198772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.199085 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.199607 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.199944 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.200599 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.200599 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.200599 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.201019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.201189 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.201525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.202243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.202243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.202906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.202906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.203217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.203418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.203762 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.204061 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.204424 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.204735 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.205053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.205422 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.205754 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.206155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.206391 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.206699 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.207014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.207329 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.207646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.207961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.208270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.208595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.208913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.209227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.209593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.212900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.214337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.214337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.214337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.214337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.214337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.215369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.215369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.215369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.215369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.216108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.216108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.216549 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.216711 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.216927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.217231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.217585 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.218027 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.218400 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.218730 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.219042 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.219360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.219673 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.219991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.220338 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.220939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.221142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.221326 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.221639 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.221954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.222263 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.222575 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.222988 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.223205 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.223512 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.223816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.224124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.224451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.224760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.225229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.225686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.229514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.231405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.232393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.232393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.232393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.232799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.232955 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.233251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.233620 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.233933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.234260 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.234590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.234902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.235211 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.235523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.235834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.236140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.236466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.236841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.237114 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.237453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.237765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.238076 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.238384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.238716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.239022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.239350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.239669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.239996 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.240421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.240626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.241223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.241447 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.241699 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.242007 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.242316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.242663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.242993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.243331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.243652 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.243987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.244302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.244637 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.244969 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.245316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.245638 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.246606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.246606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.246606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.247050 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.247191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.247453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.247761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.248177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.248389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.248749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.249062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.249412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.249725 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.250051 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.250363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.250713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.250974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.251557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.251723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.251882 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.252224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.252598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.252937 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.253271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.253620 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.253925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.254246 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.254565 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.254889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.255210 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.255693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.255895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.256216 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.256528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.256848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.257167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.257524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.258099 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.258432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.258783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.259301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.259490 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.259720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.260036 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.260349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.261136 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.261136 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.261848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.261848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.271587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.272643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.273861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.274024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.274787 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.275115 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.275435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.275743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.276064 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.276376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.276948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.277324 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.277653 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.277987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.278319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.278643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.281824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.282387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.282387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.282387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.283378 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.283692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.284031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.284348 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.284663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.284978 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.285443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.285633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.285940 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287736 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.287877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.288214 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.289056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.289056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.289419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.289694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.290579 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.290891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.291427 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.291612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.292012 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.292174 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.292501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.292852 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.293173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.293763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.294105 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.294432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.294773 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.295108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.295421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.295734 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.296045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.296376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.296692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.297005 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.297337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.297655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.297961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.298279 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.298587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.298906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.299217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.299526 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.299862 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.300192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.300544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.300866 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.301186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.301550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.305586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.306957 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.307281 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.307568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.307900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.308250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.308581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.308912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.309220 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.309557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.309865 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.310201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.310506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.310843 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.311162 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.311554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.311874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.312205 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.312513 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.312837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.313162 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.313507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.313820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.314153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.314464 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.314777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.315089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.315402 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.315714 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.316025 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.316353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.316723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.317035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.317401 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.317711 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.318034 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.318365 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.318657 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.318993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.319303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.319395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:18:16.319807 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:18:16.319895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.319895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.320079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:18:16.320218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.320431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:18:16.320531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.320695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:18:16.320833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.321113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.321211 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.321480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.321589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.321813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.321916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.322143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.322245 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.322486 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.322580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.322818 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.322934 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.323143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.323236 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.323471 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.323571 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.323788 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.323942 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.324063 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.324155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.324390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.324482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.324636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:18:16.324739 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828696-3-iscsi {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.325041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.325384 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.325706 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.326033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.326350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.326684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.327000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.327517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.327840 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.328155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.328480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.328828 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.329151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.329492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.329824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.330143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.330476 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.330794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.331200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828696-3-iscsi {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.331525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.331846 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.332169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.332594 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.332920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.333242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.333616 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.333962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.334282 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.334621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.334952 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.335282 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.335615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.335928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.336247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.336567 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.337445 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.337762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.338079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.338339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.338658 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.338988 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.339323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.339655 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.339916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.340174 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.340503 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.340837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.341157 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.341499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.341817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.346795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.347238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.347316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.347587 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.347903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.348221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.348538 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.348793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_db.sqlalchemy.engines [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.348931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.349213 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.349555 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.349820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.350132 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.350448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.350778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.351092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.351409 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.351728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.352311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.353195 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.353534 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.353856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.354178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.354496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.354813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.355130 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.355497 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.355767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.356097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.356430 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.356749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.357067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.357408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.357752 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.358066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.358382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.358701 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.359038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.359354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.359670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.360003 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.360320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.360638 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.360970 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.361305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.361620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.361949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.362269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.362585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.362901 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.363248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.363537 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.363852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.364168 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.364480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.364791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.365119 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.365488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.365811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.366131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.366448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.366780 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:18:16.367131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.367473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.367829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.368179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.368518 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.368860 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.369188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.369609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.369936 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.370275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.370596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.370917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.371240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.371569 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.371897 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.372238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.372566 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.372890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.373225 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.373573 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.373922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.374242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.374576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.374898 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.375250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.375612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.375927 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.376262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.376596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.376917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.377237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.377579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.377913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.378268 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.378581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.378907 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.379229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.379549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.379869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.380190 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.380510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.380855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.381178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.381526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.381850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.382177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.382499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.382819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.383146 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.383462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.383791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.384113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.384433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.384748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.385082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.385441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.385762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.386108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.386424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.386744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.387065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.387384 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.387698 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.388023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.388344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.388664 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.388995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.389336 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.389656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.389990 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.390309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.390626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.390952 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.391274 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.391595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.391925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.392265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.392589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.392911 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.393265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.400996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.401688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.402247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.402247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.402247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.402545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.402870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.403197 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.403520 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.403856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.404179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.404512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.404833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.405164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.405508 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.405844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.406181 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.406498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.406814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.407140 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.407491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.407833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.408162 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.408498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.408817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.409141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.409493 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.409815 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.410137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.410457 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.410788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.411540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.411540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.411732 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.412062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.412381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.412718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.413041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.413387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.413730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.414211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.414400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.414723 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.415624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.415950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.416272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.416595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.416913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.417001 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.context [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),341d3641-d12d-47f5-8051-421ca6730917(cell1) {{(pid=116750) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 04:18:16.417229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.417594 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.417923 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.418247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.418567 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.418881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.419204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.419524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.419838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.420151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.420473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.420806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.421127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.421482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.421601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:16.421816 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.422131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.422445 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.422776 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.423102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.423195 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:16.423416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.423730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.423906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:16.424045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.424403 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.424724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.425036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.425394 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.425729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.426025 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:16.426122 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.426360 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.426678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.426999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.427333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.427656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.427975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.428296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.428618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.428956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.429380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.429719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.430045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.430365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.430711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.431030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.431353 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.431759 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.432344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.432693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.433027 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.433382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.433721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.434055 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.434406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.434749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.435075 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.435424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.435755 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.436076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.436396 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.436717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.436826 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_db.sqlalchemy.engines [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.437033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.437372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.437688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.437782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_db.sqlalchemy.engines [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.438012 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.438328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.438647 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.438962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.439291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.439596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.439908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.440235 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.440551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.440886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.441207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.441548 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.441864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.442178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.442541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.442855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.443214 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.443553 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.443907 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.444224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.444540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.444870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.445189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.445526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.445841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.446202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.448424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.448791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.449147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.449951 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.450302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.450788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.452065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.452427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.452772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.453122 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.453489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.453825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.454205 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.454546 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.454880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.455207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.455537 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.455861 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.456205 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.456530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.456853 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.457177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.457528 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.457855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.458176 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.458521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.458851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.459171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.459501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.459943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.460124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.460443 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.460826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.461169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.461528 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.462386 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.462712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.463031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.463352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.463674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.463998 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.464317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.464636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.464955 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.465286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.465613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.465952 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.466279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.466597 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.466921 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.467240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.467601 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.467918 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.468294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.468615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.468947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.469295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.469621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.469950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.470278 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.470595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.470924 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.471248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.471574 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.471891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.472207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.472542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.472867 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.473192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.473554 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.473893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.474233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.474552 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.474876 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.475204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.475525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.475850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.476172 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.476495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.476826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.477505 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.478328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.478656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.478979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.479302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.479626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.479947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.480288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.480609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.480928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.481250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.481591 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.481916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.482236 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.482687 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.483016 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.483342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.483662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.483986 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.484313 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.484643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.484971 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.485305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.485744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.486070 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.486395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.486728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.487046 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.487365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.487691 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.488030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.488349 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.488668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.488985 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.489341 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.489663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.489999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.490432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.490754 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.491073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.491507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.491830 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.492153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.492490 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.492825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.493790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.494124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.494640 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.495146 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.495677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.496200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.496748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.497320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.497799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.498332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.498874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.499378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.499904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.500574 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.501099 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.501646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.502170 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.502695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.503191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.503688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.504215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.504808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.505421 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.506041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.506641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.507232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.507822 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.508406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.509023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.509633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.510151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.510482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.510829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.511167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.511513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.511855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.512180 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.512523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.512851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.513175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.513526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.513850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.514208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.514530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.514871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.515215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.515558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.516070 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.516653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.517080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.517607 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.518102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.518696 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.519105 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.519436 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.519768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.520093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.520418 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.520741 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.521067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.521415 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.521735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.523879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.524749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.525100 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.525473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.525809 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.526138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.526463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.526790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.527157 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.527479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.527834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.528173 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.530902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.531278 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.531626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.531985 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.532332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.532676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.533018 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.533380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.533722 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.534060 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.534396 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.534724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.535062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.535395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.535730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.536317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.536661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.536992 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.537340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.537670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.538001 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.538330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.538828 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.539395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.539997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.541041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.541646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.542201 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.542745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.543294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.543808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.544323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.544836 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.545378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.545962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.546479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.546979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.547495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.548007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.548519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.549028 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.549565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.550076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.550584 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.551089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.551596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.552108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.552625 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.553151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.553726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.554261 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.554682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.555189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.555740 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.556582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.557097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.557663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.558196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.558741 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.559242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.559759 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.560287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.560784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.561314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.561907 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.562412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.562912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.563434 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.563938 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.564434 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.564948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.565480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.566333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.566906 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.567341 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.567875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.568405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.568917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.569446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.569994 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.570479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.570985 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.572032 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.572529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.572919 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.573250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.573668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.574003 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.574513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.575016 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.575508 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.576040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.576588 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.577021 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.577421 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.577765 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.578210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.578709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.579202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.579692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.580233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.580766 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.581108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.581505 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.581891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.582390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.582892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.583387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.583997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.584555 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.584896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.585321 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.585651 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.586180 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.586689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.587762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.588337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.588910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.589726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.590089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.590435 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.590790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.591149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.591479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.591806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.592131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.592469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.592799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.593124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.593480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.593808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.594135 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.594459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.594784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.595108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.595431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.595753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.596076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.596405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.596761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.597095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.597462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.597795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.598125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.598450 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.599124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.599124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.599392 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.599720 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.600060 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.600390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.600704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.601154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.601506 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.601841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.602461 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.602782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.603118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.603454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.603776 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.604110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.604433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.604778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.605126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.605554 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.605844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.606164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.606479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.606813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.607117 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.607459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.607803 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.608128 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.608459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.608781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.609116 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.609464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.609798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.610222 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.610555 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.610881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.611224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.611547 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.611866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.612190 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.612512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.612829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.613149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.613515 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.613851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.614169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.614337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_db.sqlalchemy.engines [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.614507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.614835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.615164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.615489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.615810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.616153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.616472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.616797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.617120 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.617463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.617793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.618146 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.618485 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.618824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.619163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.619500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.619858 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.620187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.620544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.620897 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.621225 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.621575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.621893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:18:16.622145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:18:16.645114 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_db.sqlalchemy.engines [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.711066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.context [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),341d3641-d12d-47f5-8051-421ca6730917(cell1) {{(pid=116751) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 04:18:16.715981 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:16.717626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:16.718462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:16.720455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:16.732856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_db.sqlalchemy.engines [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.733722 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_db.sqlalchemy.engines [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.904657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_db.sqlalchemy.engines [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:18:16.945244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: WARNING keystonemiddleware.auth_token [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:18:16.952741 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: WARNING keystonemiddleware.auth_token [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:18:17.232653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: WARNING keystonemiddleware.auth_token [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:18:17.239269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: WARNING keystonemiddleware.auth_token [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:18:17.294352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: WARNING keystonemiddleware.auth_token [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:18:17.300459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: WARNING keystonemiddleware.auth_token [None req-db8d7dee-fe47-458e-a68d-876dd55227cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:18:17.306148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572292989c0 pid: 116750 (default app) Feb 12 04:18:17.579309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: WARNING keystonemiddleware.auth_token [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 04:18:17.584519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: WARNING keystonemiddleware.auth_token [None req-3f84a411-e733-4264-a99b-3ec2ae299501 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 04:18:17.591228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5572292989c0 pid: 116751 (default app) Feb 12 04:18:52.393539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c68fbe9f-0399-4c0b-8bdd-fc5cf4addd69 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Action: 'create', calling method: .version_select at 0x7f8e6a47edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2038471997"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:18:52.417844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ffab1322-bcb2-44dd-bdaa-ea0aaee0da7a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Action: 'create', calling method: .version_select at 0x7f8e6a47edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1203871030", "metadata": {"Type": "work"}}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:18:54.244212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c68fbe9f-0399-4c0b-8bdd-fc5cf4addd69 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.292891 Feb 12 04:18:54.245092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1154 bytes} [Sat Feb 12 04:18:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3296 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 12 04:18:54.262477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5e2375a2-79b8-4e33-bfe3-518b1c6c4be1 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e6a34f940>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:54.393880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ffab1322-bcb2-44dd-bdaa-ea0aaee0da7a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.175349 Feb 12 04:18:54.401498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 1/2] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 04:18:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3185 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 12 04:18:54.474115 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1189080816", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a"}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:18:54.497486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5e2375a2-79b8-4e33-bfe3-518b1c6c4be1 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 200 len: 345 microversion: 2.1 time: 0.241088 Feb 12 04:18:54.500772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:54 2022] GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:18:54.514643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a4ce34f6-c7ec-4901-81d5-2a1a4b697f93 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e6a34fe50>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:54.664880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] validate_networks() for [('5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:18:54.668732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a4ce34f6-c7ec-4901-81d5-2a1a4b697f93 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.161130 Feb 12 04:18:54.671320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 3/4] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:54 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:54.950346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-903248783", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "5cd1924f-17ba-4894-907a-e01184fe91d9"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:18:55.081396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] validate_networks() for [('5cd1924f-17ba-4894-907a-e01184fe91d9', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:18:56.503670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:18:56.505775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:18:56.506503 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:18:56.507238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:18:56.507894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:18:56.532449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:56.538559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:56.543954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:56.550829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:56.581444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:18:56.590136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for user e3609a9d4fe144b68a62ad4696301244 and project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:18:56.608563 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:18:56.613678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:18:56.771451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:18:56.773009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:18:56.773009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:18:56.773009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:18:56.775659 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:18:56.793904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-62baa9f5-1ffe-4ed7-aa69-c46f981cb9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390920 Feb 12 04:18:56.794656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 2/5] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:18:56.794778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:56.795482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:56.796503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:56.797014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:56.799472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7ebd3e8d-5c7b-49ca-9e4e-481341e93d47 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e699de310>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:56.836624 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Getting quotas for project f11a00f62cf540c79ea14b02953dfd19. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:18:56.858311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Getting quotas for user c4e830b3807c421e9039bb78a42c393d and project f11a00f62cf540c79ea14b02953dfd19. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:18:56.874521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:18:56.880587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:18:56.885968 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7ebd3e8d-5c7b-49ca-9e4e-481341e93d47 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 200 len: 346 microversion: 2.1 time: 0.090299 Feb 12 04:18:56.886545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 3/6] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:56 2022] GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:56.899359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fb86df0e-8f44-48a0-a818-f47a48c62dac tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e699ded30>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:57.012939 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fb86df0e-8f44-48a0-a818-f47a48c62dac tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 354 microversion: 2.1 time: 0.122874 Feb 12 04:18:57.013745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:56 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:57.019092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-11fbff17-dd31-469e-8dff-fcea1683d48f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:57.020314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-11fbff17-dd31-469e-8dff-fcea1683d48f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:18:57.150943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-92169f8e-c5ca-4b7a-b0ec-06f16fe14316 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.259430 Feb 12 04:18:57.152342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 4/8] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:18:57.161549 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-41a67e93-1ca8-4887-9f17-5df90649ff00 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Action: 'create', calling method: .version_select at 0x7f8e699e33a0>, body: {"snapshot": {"volume_id": "8d41a143-b38a-4b49-9570-fd9d44d85ef5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1424991253"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:18:57.504969 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-11fbff17-dd31-469e-8dff-fcea1683d48f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:18:57.525318 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-11fbff17-dd31-469e-8dff-fcea1683d48f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1218 microversion: 2.1 time: 0.510374 Feb 12 04:18:57.541641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 5/9] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:18:57 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1218 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:18:57.555433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-cf642def-dda2-468e-94cf-2cd3d6d28fcb tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e69a04c10>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:57.655948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-cf642def-dda2-468e-94cf-2cd3d6d28fcb tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 354 microversion: 2.1 time: 0.113029 Feb 12 04:18:57.665428 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 6/10] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:57 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:57.671593 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-29a30c0a-a247-43c0-854e-d81c40a33a07 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:57.672613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-29a30c0a-a247-43c0-854e-d81c40a33a07 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:18:57.965413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-29a30c0a-a247-43c0-854e-d81c40a33a07 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:18:57.972818 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-29a30c0a-a247-43c0-854e-d81c40a33a07 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1214 microversion: 2.1 time: 0.305876 Feb 12 04:18:57.973756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 7/11] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:18:57 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:18:57.988565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2f1a12ad-6bee-46cc-ba8a-429f1bb5df30 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e69a04ca0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.003103 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-41a67e93-1ca8-4887-9f17-5df90649ff00 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.849018 Feb 12 04:18:58.004665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 5/12] 10.222.0.31 () {60 vars in 1161 bytes} [Sat Feb 12 04:18:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:58.015996 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1b542e26-85f3-4434-9e52-7573b6cb4c6f tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e699e3670>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.098072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1b542e26-85f3-4434-9e52-7573b6cb4c6f tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.086000 Feb 12 04:18:58.098650 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 6/13] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:58.109470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3fd64b57-0779-4e04-b216-17dc80c0746d tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e699fd040>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.173686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3fd64b57-0779-4e04-b216-17dc80c0746d tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.068006 Feb 12 04:18:58.180999 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 7/14] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:58.187850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-18193973-62ac-4e64-920d-18bb49064b9c tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e699fde50>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.237097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-18193973-62ac-4e64-920d-18bb49064b9c tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.046959 Feb 12 04:18:58.237097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 8/15] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:58.339788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2f1a12ad-6bee-46cc-ba8a-429f1bb5df30 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 202 len: 0 microversion: 2.1 time: 0.355040 Feb 12 04:18:58.340421 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 8/16] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:18:57 2022] DELETE /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:18:58.348355 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8f8d6480-b197-477f-be1d-d09782090ada tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e699fda60>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.465432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8f8d6480-b197-477f-be1d-d09782090ada tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.120816 Feb 12 04:18:58.466259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 9/17] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:58.546761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a1aad458-8aec-417e-bb8f-a0f401f104d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.547347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a1aad458-8aec-417e-bb8f-a0f401f104d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:18:58.682847 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a1aad458-8aec-417e-bb8f-a0f401f104d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:18:58.701706 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a1aad458-8aec-417e-bb8f-a0f401f104d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1218 microversion: 2.1 time: 0.158515 Feb 12 04:18:58.702299 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 9/18] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:18:58.991018 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-71eadaa2-c878-4749-b0ab-94c65d08430b tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:58.991631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-71eadaa2-c878-4749-b0ab-94c65d08430b tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:18:59.245625 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b508a5e8-5285-4008-93f4-86a0429c96c4 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e691a8d30>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:59.270968 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-71eadaa2-c878-4749-b0ab-94c65d08430b tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:18:59.306603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-71eadaa2-c878-4749-b0ab-94c65d08430b tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1214 microversion: 2.1 time: 0.319123 Feb 12 04:18:59.307835 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 10/19] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:18:58 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:18:59.419516 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b508a5e8-5285-4008-93f4-86a0429c96c4 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.180902 Feb 12 04:18:59.420108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 10/20] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:18:59 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:59.478772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-92f46ae7-0c0d-428a-b88f-6c0a50b0ae25 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e699e3820>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:59.597668 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-92f46ae7-0c0d-428a-b88f-6c0a50b0ae25 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.123137 Feb 12 04:18:59.603255 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 11/21] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:18:59 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:18:59.719289 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:18:59.720529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:18:59.730380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:59.732407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:18:59.734754 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:18:59.735423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:00.301126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:00.301126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-70ba5e4f-246c-4be6-8ccf-d816b22c03c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1222 microversion: 2.1 time: 0.286022 Feb 12 04:19:00.301126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 11/22] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:18:59 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:00.304128 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-361055853", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:00.316929 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] validate_networks() for [('d4eba8ad-7c32-4044-a2b9-370377016af4', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:19:00.323466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:00.324089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:00.334718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:00.335179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:00.336294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:00.336746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:00.665393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:00.684767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e650f022-d149-4b1e-818a-c1b8addeabfa tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1218 microversion: 2.1 time: 0.361189 Feb 12 04:19:00.685446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 12/23] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:00 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:00.699442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-001b5710-886d-40c5-bdf7-e6a35a181c49 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e699ded30>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:00.743460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-001b5710-886d-40c5-bdf7-e6a35a181c49 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.055241 Feb 12 04:19:00.744675 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 13/24] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:00 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:00.753029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8795b4ec-410a-46b2-9afc-977cd405ddf3 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e691461f0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:00.809740 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8795b4ec-410a-46b2-9afc-977cd405ddf3 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.060055 Feb 12 04:19:00.814954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 14/25] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:00 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:01.024607 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:01.025305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:01.044600 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.045155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.046208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.049062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.100191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:19:01.100873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:19:01.102125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:19:01.103066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:19:01.103698 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:19:01.123732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.124193 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.125011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.125492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.186239 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Getting quotas for project b322dc86ac594838a4aebaf0645d9c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:01.215192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Getting quotas for user 12659c94a0e54cb885e5398cd4ce4469 and project b322dc86ac594838a4aebaf0645d9c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:01.248227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:19:01.259000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:01.284844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-32985ac9-b6e0-4f47-91d5-d6cd43f17ccd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1222 microversion: 2.1 time: 0.264395 Feb 12 04:19:01.287028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:19:01.295236 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 15/26] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:01 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:01.515403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1074edc5-79e2-4927-82ea-8c4166b5ee21 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.317569 Feb 12 04:19:01.516997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 12/27] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:19:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 04:19:01.534195 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9fa13454-9b70-42cb-81ed-d959a17977b9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:01.536190 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9fa13454-9b70-42cb-81ed-d959a17977b9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:01.688694 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9fa13454-9b70-42cb-81ed-d959a17977b9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:01.702861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:01.709547 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:01.711965 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.712417 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.713200 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:01.713662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:01.719833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9fa13454-9b70-42cb-81ed-d959a17977b9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1221 microversion: 2.1 time: 0.173311 Feb 12 04:19:01.722343 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 16/28] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:01 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:01.755393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-255eb26f-d08d-44e1-b299-85b24711442b tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e69128af0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:01.825160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-255eb26f-d08d-44e1-b299-85b24711442b tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 288 microversion: 2.1 time: 0.073294 Feb 12 04:19:01.825769 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 17/29] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:01 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:19:01.835407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6b338ab2-7af9-44c4-b295-7bb629a8926a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e690e4790>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:01.999399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6b338ab2-7af9-44c4-b295-7bb629a8926a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.167434 Feb 12 04:19:01.999968 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 18/30] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:01 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:02.005238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4c1d0b3c-bca9-4180-9a47-240a1fda80ed tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e690e4a60>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:02.204257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4c1d0b3c-bca9-4180-9a47-240a1fda80ed tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 202 len: 0 microversion: 2.1 time: 0.202859 Feb 12 04:19:02.206092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 19/31] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 04:19:01 2022] DELETE /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:19:02.213585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-46001537", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:02.223763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:02.235838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-df20ea4b-d796-4376-b1d8-7290d21937fe tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1218 microversion: 2.1 time: 0.537404 Feb 12 04:19:02.240746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 13/32] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:01 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1218 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:02.246132 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3eeeb35c-495d-46b2-8315-21189bcd37ad tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e6911fb80>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:02.292477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3eeeb35c-495d-46b2-8315-21189bcd37ad tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.050376 Feb 12 04:19:02.293335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 14/33] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:02 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:02.307342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:02.308122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:02.322188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:02.322864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:02.323850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:02.327096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:02.358677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] validate_networks() for [('d4eba8ad-7c32-4044-a2b9-370377016af4', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:19:02.550436 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:02.566299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f947b72d-11e8-4b8b-810a-f9fe3d8bf9be tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1214 microversion: 2.1 time: 0.262398 Feb 12 04:19:02.576841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 15/34] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:02 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:03.017181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f21260de-fc89-46ae-904f-12d8735a4f48 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e6911f5e0>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:03.105203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f21260de-fc89-46ae-904f-12d8735a4f48 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.096045 Feb 12 04:19:03.106962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 16/35] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:03 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:03.258959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:03.259618 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:03.269757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:03.270210 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:03.271000 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:03.273138 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:03.414704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:03.423791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e1be879a-5f17-4235-9b54-5aab1a3d7b51 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1210 microversion: 2.1 time: 0.170029 Feb 12 04:19:03.434269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 17/36] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:03 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:03.434269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2387d56b-d487-4442-b55b-7c099b525678 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e69127e50>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:03.482619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2387d56b-d487-4442-b55b-7c099b525678 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.053796 Feb 12 04:19:03.487791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 18/37] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:03 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:03.561098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: .version_select at 0x7f8e69a10c10>, body: {"keypair": {"name": "tempest-keypair-1306831503"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:03.595273 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:03.600140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:03.836038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:19:03.836570 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:19:03.837033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:19:03.838049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:19:03.844090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:19:03.858497 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:03.859176 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:03.860157 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:03.860766 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:03.890746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Getting quotas for project b322dc86ac594838a4aebaf0645d9c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:03.901472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Getting quotas for user 12659c94a0e54cb885e5398cd4ce4469 and project b322dc86ac594838a4aebaf0645d9c21. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:03.929011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:19:03.929011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:19:03.978630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:03.986713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:04.009357 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2b47f9e0-736d-4034-8aa5-7993f825e617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.519999 Feb 12 04:19:04.009990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 19/38] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 04:19:03 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 521 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:19:04.014602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:04.015673 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:04.022526 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:04.023161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:04.024703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:04.025334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:04.114113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:04.126693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-739c3514-c655-4fbb-a9fd-2e64bb5254d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1214 microversion: 2.1 time: 0.112338 Feb 12 04:19:04.128224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 20/39] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:04 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:04.133602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-79929a33-68bb-4734-95c1-3088ec3c5058 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e691270d0>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:04.143589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-780bb56d-74dd-4c6a-903e-e019c9cdffb8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.935710 Feb 12 04:19:04.146318 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 20/40] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:19:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:19:04.186455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fcb15a6d-87ae-4ce1-8991-42533540a9d6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:04.186455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fcb15a6d-87ae-4ce1-8991-42533540a9d6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:04.249621 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-79929a33-68bb-4734-95c1-3088ec3c5058 tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.120140 Feb 12 04:19:04.250420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 21/41] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:04 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:04.301126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fcb15a6d-87ae-4ce1-8991-42533540a9d6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:04.316772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fcb15a6d-87ae-4ce1-8991-42533540a9d6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1220 microversion: 2.1 time: 0.144268 Feb 12 04:19:04.320668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 21/42] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:04 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:04.441924 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:04.442538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:04.462902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:04.465607 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:04.466506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:04.467042 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:04.496499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-11a2eba0-3b16-4d4e-ba7d-d8d643fe5735 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e6918cdc0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:04.577643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-11a2eba0-3b16-4d4e-ba7d-d8d643fe5735 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 200 len: 287 microversion: 2.1 time: 0.086080 Feb 12 04:19:04.581793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 22/43] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:04 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:04.657134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:04.683990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6cdd9dde-7efb-4c15-936c-c7c19b84d86f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1210 microversion: 2.1 time: 0.233906 Feb 12 04:19:04.683990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 22/44] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:04 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1210 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:05.144756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:05.146761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:05.156198 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:05.157129 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:05.165241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:05.165241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:05.263458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-25f5dd55-061c-4edd-ab4f-128a15de6d7a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e690f2f70>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:05.323809 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-25f5dd55-061c-4edd-ab4f-128a15de6d7a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 200 len: 353 microversion: 2.1 time: 0.065333 Feb 12 04:19:05.324652 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 23/45] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:05 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:05.334325 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-892d9320-9fee-498e-8ff2-1ae04a060488 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:05.335284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-892d9320-9fee-498e-8ff2-1ae04a060488 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:05.343211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:05.358585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ab40037c-fc3f-410c-ac08-7ef706f5b576 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1270 microversion: 2.1 time: 0.211502 Feb 12 04:19:05.370183 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 23/46] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:05 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:05.404152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-892d9320-9fee-498e-8ff2-1ae04a060488 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:05.426139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-892d9320-9fee-498e-8ff2-1ae04a060488 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1220 microversion: 2.1 time: 0.095408 Feb 12 04:19:05.428658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 24/47] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:05 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:05.596273 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a4d79e7d-0912-4338-b291-65bd3fb02000 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e690dcca0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:05.653343 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-a4d79e7d-0912-4338-b291-65bd3fb02000 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] HTTP exception thrown: Snapshot 709878dd-81a1-4e59-bbdf-3822563c6b10 could not be found. Feb 12 04:19:05.653950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a4d79e7d-0912-4338-b291-65bd3fb02000 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Returning 404 to user: Snapshot 709878dd-81a1-4e59-bbdf-3822563c6b10 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:19:05.655631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a4d79e7d-0912-4338-b291-65bd3fb02000 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10" status: 404 len: 111 microversion: 2.1 time: 0.063426 Feb 12 04:19:05.656395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 24/48] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 04:19:05 2022] GET /compute/v2.1/os-snapshots/709878dd-81a1-4e59-bbdf-3822563c6b10 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:19:05.667344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-765f488d-f154-4101-879c-d5b393692cad tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e6a2ef790>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:05.736722 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: .version_select at 0x7f8e6913ac10>, body: {"keypair": {"name": "tempest-keypair-495914876"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:05.770353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:05.797880 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:06.041524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-765f488d-f154-4101-879c-d5b393692cad tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 202 len: 0 microversion: 2.1 time: 0.380631 Feb 12 04:19:06.045143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 25/49] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:19:05 2022] DELETE /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:19:06.049362 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.050919 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:06.072111 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.072671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.073635 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.074095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.417756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:06.427983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-dbf03777-3d64-4c8a-8b4c-4aed6863ff91 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1274 microversion: 2.1 time: 0.384749 Feb 12 04:19:06.438436 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 26/50] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1274 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:06.438686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:06.448145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-22970311-665f-4c7c-bd35-bb087357a259 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e690f3dc0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.459583 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:06.490602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b5d4f02b-c0e1-4c7c-a74b-6986615fea10 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.876511 Feb 12 04:19:06.491746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 04:19:05 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:06.498107 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a1349a87-b188-4e14-b130-f5ca42ade64a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Calling method '.version_select at 0x7f8e691270d0>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.583642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-22970311-665f-4c7c-bd35-bb087357a259 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] HTTP exception thrown: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. Feb 12 04:19:06.584324 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-22970311-665f-4c7c-bd35-bb087357a259 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Returning 404 to user: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:19:06.586259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-22970311-665f-4c7c-bd35-bb087357a259 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 404 len: 109 microversion: 2.1 time: 0.154988 Feb 12 04:19:06.587013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 27/52] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:19:06.613743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.613743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:06.635052 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.638206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.642333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.642333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.685837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-a1349a87-b188-4e14-b130-f5ca42ade64a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] HTTP exception thrown: Volume 41f45a30-2278-49a3-9bfc-63681c0dbef6 could not be found. Feb 12 04:19:06.687225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a1349a87-b188-4e14-b130-f5ca42ade64a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] Returning 404 to user: Volume 41f45a30-2278-49a3-9bfc-63681c0dbef6 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:19:06.689738 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a1349a87-b188-4e14-b130-f5ca42ade64a tempest-VolumesGetTestJSON-449231552 tempest-VolumesGetTestJSON-449231552-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6" status: 404 len: 109 microversion: 2.1 time: 0.195836 Feb 12 04:19:06.690853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 26/53] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/os-volumes/41f45a30-2278-49a3-9bfc-63681c0dbef6 => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:19:06.735819 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.739501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:06.768691 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.768961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.777514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:06.777844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:06.880903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:06.899397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-052a0c8a-4ddc-4a5a-9fc7-a1cfc9176721 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1276 microversion: 2.1 time: 0.301909 Feb 12 04:19:06.901300 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 28/54] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:06.914884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7fd6066f-c1d7-48dd-ab9c-8162b8a4e96a tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e690f30d0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:06.977224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-7fd6066f-c1d7-48dd-ab9c-8162b8a4e96a tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] HTTP exception thrown: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. Feb 12 04:19:06.978478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7fd6066f-c1d7-48dd-ab9c-8162b8a4e96a tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Returning 404 to user: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:19:06.980213 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7fd6066f-c1d7-48dd-ab9c-8162b8a4e96a tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 404 len: 109 microversion: 2.1 time: 0.076717 Feb 12 04:19:06.980984 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 29/55] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:19:06 2022] DELETE /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:19:06.990258 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-615cd1a2-5acd-4709-bfb5-8ee625da5199 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Calling method '.version_select at 0x7f8e690dcf70>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:07.079177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-615cd1a2-5acd-4709-bfb5-8ee625da5199 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] HTTP exception thrown: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. Feb 12 04:19:07.080382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-615cd1a2-5acd-4709-bfb5-8ee625da5199 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] Returning 404 to user: Volume 8d41a143-b38a-4b49-9570-fd9d44d85ef5 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:19:07.081044 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-615cd1a2-5acd-4709-bfb5-8ee625da5199 tempest-VolumesSnapshotsTestJSON-1187493087 tempest-VolumesSnapshotsTestJSON-1187493087-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5" status: 404 len: 109 microversion: 2.1 time: 0.095532 Feb 12 04:19:07.082268 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 30/56] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/os-volumes/8d41a143-b38a-4b49-9570-fd9d44d85ef5 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:19:07.481691 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:07.482361 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:07.532473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:07.533178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:07.534201 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:07.534794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:07.687118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:07.696742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a44e5a64-d1e4-456b-bb1f-461aa42b20a9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1272 microversion: 2.1 time: 1.004009 Feb 12 04:19:07.699149 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 27/57] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:06 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1272 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:07.759781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:07.769125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-db910603-16f3-44c0-846a-ec7fcb579cd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1272 microversion: 2.1 time: 0.315595 Feb 12 04:19:07.782378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 31/58] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:07 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:07.917649 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:07.927500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:07.961956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:07.963396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:07.965079 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:07.966071 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:08.363306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:08.384242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2363a3c6-846c-47da-912f-fa9d2c59fc24 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1276 microversion: 2.1 time: 0.463027 Feb 12 04:19:08.399110 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 28/59] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:07 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:08.720834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:08.721879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:08.753995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:08.762041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:08.762041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:08.762041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:08.794632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:08.795853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:08.814243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:08.815013 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:08.821147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:08.824397 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:09.645574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:09.649576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:09.666473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-67767f72-5f14-4fdd-a324-efb16d950fff tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1278 microversion: 2.1 time: 0.955928 Feb 12 04:19:09.667373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 32/60] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:08 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1278 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:09.682344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:09.682565 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-10916042-ac87-48b4-9d3a-89ed22db539c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1272 microversion: 2.1 time: 0.877108 Feb 12 04:19:09.683418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 29/61] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:08 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1272 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:09.688535 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:09.708841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:09.709647 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:09.711303 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:09.711979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:10.687664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:10.689097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:10.710616 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:10.720218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:10.720218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:10.720218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:11.528206 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:11.528206 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-286ff37a-33e8-4b01-aefe-63e80d5e7e47 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1278 microversion: 2.1 time: 0.835605 Feb 12 04:19:11.528206 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 30/62] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:10 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1278 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:11.558177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:11.562203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:11.599011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:11.599483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:11.600327 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:11.600799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:11.691050 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:11.702376 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-af26bf35-57dc-4069-be1f-3d74ade90050 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 2.033787 Feb 12 04:19:11.703956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 33/63] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:09 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:12.545043 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:12.545650 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:12.558826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:12.559481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:12.560326 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:12.560941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:12.748377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:12.757247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-91aa4037-293c-42a1-9c95-9f4d85ee64ec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1278 microversion: 2.1 time: 0.216508 Feb 12 04:19:12.761658 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 34/64] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:12 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:12.776485 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:12.780063 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:12.792466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:12.792874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:12.798191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:12.799317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:12.998334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:13.006387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1eb06e38-df7f-4834-8e42-269c4e363d6a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 1.484670 Feb 12 04:19:13.007285 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 31/65] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:11 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:13.777864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:13.778728 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:13.791301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:13.792713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:13.797572 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:13.798270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:13.807848 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:13.816775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-dc7632f9-5ed7-41eb-a4e3-41b8b724cb67 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 1.053734 Feb 12 04:19:13.822066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 35/66] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:12 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:14.024341 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:14.025267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:14.036142 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:14.046882 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:14.048416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:14.049166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:14.801495 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:14.827872 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cfc0ee98-5664-4d13-9dc9-722fad45200f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 1.052233 Feb 12 04:19:14.835110 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 32/67] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:13 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:15.405187 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-45964bbd-6ff8-4862-82aa-547588c5f127 req-06645cde-a389-48ce-8b8e-aed9d43b9aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d39788-4a0a-4590-811a-bda70e802bc8", "tag": "28c9098c-2911-456c-a866-c46cf15a8c35"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:15.408399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:15.408399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:19:15.420336 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:15.547559 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-45964bbd-6ff8-4862-82aa-547588c5f127 req-06645cde-a389-48ce-8b8e-aed9d43b9aa6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:15.547559 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-45964bbd-6ff8-4862-82aa-547588c5f127 req-06645cde-a389-48ce-8b8e-aed9d43b9aa6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:15.550781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8f6e6d84-9635-494c-96a3-41c92d698f97 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 1.415112 Feb 12 04:19:15.550781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 36/68] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:14 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:15.551994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-45964bbd-6ff8-4862-82aa-547588c5f127 req-06645cde-a389-48ce-8b8e-aed9d43b9aa6 service nova] Creating event network-changed:28c9098c-2911-456c-a866-c46cf15a8c35 for instance 30d39788-4a0a-4590-811a-bda70e802bc8 on hv-cinder-82869 Feb 12 04:19:15.551994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-45964bbd-6ff8-4862-82aa-547588c5f127 req-06645cde-a389-48ce-8b8e-aed9d43b9aa6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116750) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 04:19:15.551994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:15.551994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:15.551994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:15.552310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:15.552391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:15.552391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:15.552527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.compute.rpcapi [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 12 04:19:15.552527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] Releasing lock "compute-rpcapi-router" {{(pid=116750) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 04:19:15.552716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:15.552716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:15.552716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:15.552716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:15.553815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-586c8550-037d-4189-a60f-eddce61b6b97 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.656537 Feb 12 04:19:15.553815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 33/69] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:15.553815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2065224808", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a470119b-e597-4f7c-b914-bdedfeebd027"}], "security_groups": [{"name": "tempest-securitygroup--962866203"}], "key_name": "tempest-keypair-1306831503", "user_data": "}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:15.845636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] validate_networks() for [('a470119b-e597-4f7c-b914-bdedfeebd027', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:19:16.278011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:16.278011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-981071bc-c38d-405c-a63c-1a5caa983937 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.781282 Feb 12 04:19:16.278011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 37/70] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:15 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:16.278011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:16.279871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:16.279871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:16.279871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:16.279871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:16.280195 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:16.801336 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:16.815547 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-12437fb4-9235-4404-862f-bb1b729ccaf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.577803 Feb 12 04:19:16.817723 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 38/71] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:16 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:16.832869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:16.836231 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:16.845084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:16.846468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:16.850074 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:16.850897 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:17.183557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:19:17.184354 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:19:17.184833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:19:17.185459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:19:17.186020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:19:17.237175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:17.238169 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:17.239216 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:17.240933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:17.361234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:17.361234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:17.373138 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:19:17.378736 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:19:17.688063 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:17.703437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-083625a2-6769-414c-9140-235aad7771da tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.883867 Feb 12 04:19:17.705086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 39/72] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:16 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:17.718067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:17.729599 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:17.747734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:17.753049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:17.764294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:17.767250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:17.787731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f5adce60-db3a-4363-8e2c-78ac9b1fac35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.291659 Feb 12 04:19:17.789403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 34/73] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 04:19:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 04:19:18.222977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-42e8a173-9b68-46bf-a4a6-50367525d528 req-4bb35d50-70dc-4c5a-aca8-898d4f5ae5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ffc43c-6075-4974-9b87-bed6a78914c3", "tag": "5d181d11-dd58-4c59-a93c-997e0ea1eb58"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:18.225975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:18.225975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:19:18.246604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-42e8a173-9b68-46bf-a4a6-50367525d528 req-4bb35d50-70dc-4c5a-aca8-898d4f5ae5ba service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.247898 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-42e8a173-9b68-46bf-a4a6-50367525d528 req-4bb35d50-70dc-4c5a-aca8-898d4f5ae5ba service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:18.269920 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-42e8a173-9b68-46bf-a4a6-50367525d528 req-4bb35d50-70dc-4c5a-aca8-898d4f5ae5ba service nova] Creating event network-changed:5d181d11-dd58-4c59-a93c-997e0ea1eb58 for instance 91ffc43c-6075-4974-9b87-bed6a78914c3 on hv-cinder-82869 Feb 12 04:19:18.276292 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-42e8a173-9b68-46bf-a4a6-50367525d528 req-4bb35d50-70dc-4c5a-aca8-898d4f5ae5ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485453 Feb 12 04:19:18.277512 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 35/74] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:18.283402 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-830079d3-d862-4082-8fba-834ffed49927 req-0835010b-7110-4d77-934b-25eff6d8a409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d27b809-ac65-4266-99af-19350a4a9c03", "tag": "d5e20402-d3d7-4588-9215-82923e13decf"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:18.285160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:18.285160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:19:18.294781 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-830079d3-d862-4082-8fba-834ffed49927 req-0835010b-7110-4d77-934b-25eff6d8a409 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.296025 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-830079d3-d862-4082-8fba-834ffed49927 req-0835010b-7110-4d77-934b-25eff6d8a409 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:18.309577 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-830079d3-d862-4082-8fba-834ffed49927 req-0835010b-7110-4d77-934b-25eff6d8a409 service nova] Creating event network-changed:d5e20402-d3d7-4588-9215-82923e13decf for instance 5d27b809-ac65-4266-99af-19350a4a9c03 on hv-cinder-82869 Feb 12 04:19:18.315836 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-830079d3-d862-4082-8fba-834ffed49927 req-0835010b-7110-4d77-934b-25eff6d8a409 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036780 Feb 12 04:19:18.317084 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 36/75] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:18.324494 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:18.325601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:18.485978 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:18.495204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:18.498039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:18.499550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9ef2fd41-b217-4258-a9c8-e0d308394676 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1282 microversion: 2.20 time: 0.181084 Feb 12 04:19:18.500723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 37/76] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:18 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:18.530669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:18.532440 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:18.564764 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.573907 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:18.586924 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.587375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:18.663440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:18.676701 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-381f3302-afba-43a4-916c-604378a8d598 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.965937 Feb 12 04:19:18.695267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 40/77] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:17 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:18.734040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:18.734961 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:18.744013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.757969 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:18.759519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:18.760103 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:19.508633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:19.518347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fa415a32-a1c0-4452-9583-c04db78f848f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 1.016250 Feb 12 04:19:19.531134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 38/78] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:18 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:19.546196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-181434573", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "306165a8-01e9-47a6-9b7a-50f5488101e0"}], "security_groups": [{"name": "tempest-securitygroup--94807970"}], "key_name": "tempest-keypair-495914876", "user_data": "}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:19.741300 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:19.767631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1cdb690d-a40b-4db9-8475-56ff93ba8d3e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 1.022751 Feb 12 04:19:19.768669 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 41/79] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:18 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:19.776382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:19.785798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:19.824527 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:19.825139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:19.826201 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:19.826831 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.038235 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:20.048019 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:20.050290 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:20.055097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-72056c89-470d-419e-9661-cc8cb8ac4011 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1286 microversion: 2.20 time: 0.281023 Feb 12 04:19:20.055097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 42/80] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:19 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1286 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:20.056289 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:20.057050 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:20.076774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:20.079107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.081600 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:20.082043 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.160779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] validate_networks() for [('306165a8-01e9-47a6-9b7a-50f5488101e0', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:19:20.586012 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:20.602210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-cbb78da8-6631-4012-ab34-4c3ae93f11d3 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.547175 Feb 12 04:19:20.606339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 43/81] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:20 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:20.613063 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a9fd29eb-70fb-45b0-87e4-b43e26d1223b tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e691281f0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:20.703416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a9fd29eb-70fb-45b0-87e4-b43e26d1223b tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/1cb5caec-79f9-4b8d-a14c-c3f82f30de1f" status: 200 len: 351 microversion: 2.1 time: 0.095580 Feb 12 04:19:20.704061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 44/82] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:20 2022] GET /compute/v2.1/os-volumes/1cb5caec-79f9-4b8d-a14c-c3f82f30de1f => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:20.709574 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-411d9da7-9ea2-47f4-ab0f-7cb4b8220f85 req-ddf06e5b-8b05-4556-b7be-28ce102bf018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde7f41-c793-4cdd-b9ac-94923b7ab588", "tag": "1aa44ba5-96e3-4bef-be23-68c273fda544"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:20.713890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:20.713890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:20.744451 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-411d9da7-9ea2-47f4-ab0f-7cb4b8220f85 req-ddf06e5b-8b05-4556-b7be-28ce102bf018 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:20.748852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-411d9da7-9ea2-47f4-ab0f-7cb4b8220f85 req-ddf06e5b-8b05-4556-b7be-28ce102bf018 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.827365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-411d9da7-9ea2-47f4-ab0f-7cb4b8220f85 req-ddf06e5b-8b05-4556-b7be-28ce102bf018 service nova] Creating event network-changed:1aa44ba5-96e3-4bef-be23-68c273fda544 for instance adde7f41-c793-4cdd-b9ac-94923b7ab588 on hv-cinder-82869 Feb 12 04:19:20.828923 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-411d9da7-9ea2-47f4-ab0f-7cb4b8220f85 req-ddf06e5b-8b05-4556-b7be-28ce102bf018 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116751) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 04:19:20.831693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:20.836905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.838875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:20.840308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:20.898686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.compute.rpcapi [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 12 04:19:20.906467 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] Releasing lock "compute-rpcapi-router" {{(pid=116751) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 04:19:20.958391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1b120db8-9dae-48d9-8f7e-b38b9cc8ade0 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252582 Feb 12 04:19:20.959145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 45/83] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:20.983585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:20.984929 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:21.006295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.009113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.011530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.012298 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.448873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:19:21.450634 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:19:21.451733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:19:21.453070 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:19:21.455022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:19:21.457395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:21.469630 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-63491f00-e69a-47a4-9f6f-20a2e37ac336 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.508874 Feb 12 04:19:21.470290 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.470442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 46/84] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:20 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:21.483260 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.484573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.485121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.485332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:21.485906 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:21.506956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.510322 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.519457 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.520276 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.536363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:21.545943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:21.576311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:19:21.580322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:19:21.749786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fb7a7cba-5078-41a7-80b2-30b3470f6068 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.217068 Feb 12 04:19:21.750430 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 39/85] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:19:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:19:21.763659 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:21.766121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:21.802251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.805559 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:21.806682 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:21.809072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:22.117046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.127519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.129235 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.130560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-54349a3b-3004-4154-a7c7-a06c15f76bbe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1352 microversion: 2.20 time: 0.378952 Feb 12 04:19:22.131261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 40/86] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:21 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1352 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:22.136177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:22.136935 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:22.143611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:22.144369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:22.145310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:22.145882 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:22.167427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.177304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-39f9fef0-444e-402a-ac1c-6dc890171373 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.705700 Feb 12 04:19:22.182119 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 47/87] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:21 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:22.200355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7dbf9839-a781-427f-8693-b6a89400d393 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:22.202208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7dbf9839-a781-427f-8693-b6a89400d393 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:22.343927 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7dbf9839-a781-427f-8693-b6a89400d393 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.351885 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7dbf9839-a781-427f-8693-b6a89400d393 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1236 microversion: 2.1 time: 0.167768 Feb 12 04:19:22.361480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 48/88] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:22 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1236 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:22.452818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.460837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-60c36a22-836f-48e4-abe8-a5dcf44a794d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.328367 Feb 12 04:19:22.461770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 41/89] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:22 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:22.488514 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:22.488777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:22.495643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:22.496322 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:22.497252 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:22.497852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:22.664757 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:22.672808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b4226ddd-4b23-450f-8c3e-641ec7edbf03 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.188479 Feb 12 04:19:22.673401 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 49/90] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:22 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:22.814446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ea514492-859e-4da8-9b5a-119eb51c5587 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e6913a310>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:22.939772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ea514492-859e-4da8-9b5a-119eb51c5587 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/0e87e169-8df6-473c-b4bd-8d7c2944c713" status: 200 len: 350 microversion: 2.1 time: 0.128756 Feb 12 04:19:22.940502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 42/91] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:22 2022] GET /compute/v2.1/os-volumes/0e87e169-8df6-473c-b4bd-8d7c2944c713 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:23.149753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:23.150284 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:23.156047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.156488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.157314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.157744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.196663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:23.200391 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:23.204233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.204818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.205756 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.206302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.394725 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.409034 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.411310 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.412671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8c44e20b-d0a7-46f2-bbd7-1c1e6fcaf478 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.266634 Feb 12 04:19:23.423894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 50/92] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:23 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:23.423894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:23.423894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:23.429371 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.429909 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.430775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.431326 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.469836 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.479798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-dfba2057-05f8-46cb-9a17-607aeac2a941 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.286784 Feb 12 04:19:23.485989 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 43/93] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:23 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:23.490716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:23.491449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:23.498372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.499126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.500120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.500729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.524530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.534374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-040b1945-9f83-4f61-b47f-e7b96e7cd8c9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1240 microversion: 2.1 time: 0.118363 Feb 12 04:19:23.535257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 51/94] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:23 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:23.647281 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-57339234-58e8-4c42-8cac-ef2201829ac7 req-ae72d193-c89f-4346-83ed-4b6b475478c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:23.651295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:23.651295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:23.663631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-57339234-58e8-4c42-8cac-ef2201829ac7 req-ae72d193-c89f-4346-83ed-4b6b475478c5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.664260 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-57339234-58e8-4c42-8cac-ef2201829ac7 req-ae72d193-c89f-4346-83ed-4b6b475478c5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.684575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-57339234-58e8-4c42-8cac-ef2201829ac7 req-ae72d193-c89f-4346-83ed-4b6b475478c5 service nova] Creating event network-changed:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:19:23.687525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-57339234-58e8-4c42-8cac-ef2201829ac7 req-ae72d193-c89f-4346-83ed-4b6b475478c5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050210 Feb 12 04:19:23.688136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 52/95] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:23.691389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.694782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:23.695473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:23.702470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.703320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.704377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:23.705006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:23.709532 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-dd537d6a-d9cf-4e09-b228-1b37a79c7833 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.220851 Feb 12 04:19:23.710841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 44/96] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:23 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:23.941921 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:23.949648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ca6bdd1c-12c9-49a1-bda7-6628a55988dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.258991 Feb 12 04:19:23.950228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 53/97] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:23 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:24.432289 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.432917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:24.439031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.439582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.440393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.440831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.497209 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.497738 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:24.505735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.506189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.506972 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.508102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.643254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:24.651448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:24.653859 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:24.655255 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7d349dd3-fbd4-422e-ba70-ac2153e2d8f5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.227330 Feb 12 04:19:24.666544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 45/98] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:19:24.671676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.672352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:24.681150 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.681637 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.687318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.687318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.723270 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:24.733367 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d530a3b8-a423-456c-99d5-9a4a9f0d6b5a tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.240607 Feb 12 04:19:24.743267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 54/99] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:24.743267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.743267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:24.750371 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.751261 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.752124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.752654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.796376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:24.807861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3c3df574-d6bf-4a6b-a05a-0dac233dc732 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1288 microversion: 2.1 time: 0.139991 Feb 12 04:19:24.819974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 46/100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1288 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:24.878040 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3cfe1054-afe3-4ef8-a002-d95545ee380f tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e68847160>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.963908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3cfe1054-afe3-4ef8-a002-d95545ee380f tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/dfd54d7d-a766-449c-95c6-9005e7942548" status: 200 len: 351 microversion: 2.1 time: 0.091374 Feb 12 04:19:24.964480 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 47/101] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/os-volumes/dfd54d7d-a766-449c-95c6-9005e7942548 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:24.969296 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:24.970152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:24.979573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.980231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:24.981003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:24.981743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:25.093342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:25.100936 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c43a22a0-8891-444b-8c0a-54ae7f4fbe0c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.364891 Feb 12 04:19:25.101977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 55/102] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:25.109262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2ef5b33e-5847-4c45-8932-f3b4dff38e07 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e6913c1f0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.219220 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2ef5b33e-5847-4c45-8932-f3b4dff38e07 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.115731 Feb 12 04:19:25.219789 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 56/103] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:25.231856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b2b17449-b235-4f0f-a7f7-b6b76bd1aeec tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e6905c940>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.262474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:25.271275 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-41999e56-3828-45dd-9e65-3d96266e8cee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.305433 Feb 12 04:19:25.276430 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 48/104] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:24 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:25.321770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b2b17449-b235-4f0f-a7f7-b6b76bd1aeec tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093781 Feb 12 04:19:25.322363 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 57/105] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:19:25.333806 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4a9a9a24-621e-43b3-ba93-54ffbaf37e57 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e68860f70>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.414133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4a9a9a24-621e-43b3-ba93-54ffbaf37e57 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082798 Feb 12 04:19:25.414133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 49/106] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:25.424550 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8b1119ee-4da2-46c2-8c7b-8f07b25ef70f tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e690f3af0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.512022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8b1119ee-4da2-46c2-8c7b-8f07b25ef70f tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086426 Feb 12 04:19:25.512022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 58/107] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:25.520017 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d9236329-6fd0-4425-8f70-2d69ae4d284c tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e68860d30>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.609035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d9236329-6fd0-4425-8f70-2d69ae4d284c tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092291 Feb 12 04:19:25.610426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 50/108] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:25.624067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-69b0b97a-231a-497a-94f5-da5323f401ed tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e690f3a60>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.677182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.678390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:25.687191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:25.691062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:25.691902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:25.692353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:25.745819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-69b0b97a-231a-497a-94f5-da5323f401ed tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.125174 Feb 12 04:19:25.754582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 59/109] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:25.754582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:25.754582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:25.760914 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:25.761675 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:25.762697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:25.763412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.021535 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.027742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.030358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f9b1b953-96b2-40e1-937d-6e07c62609e9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.281219 Feb 12 04:19:26.031173 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 60/110] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:26.039187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-32e7215d-febc-4aa1-9a6a-4ff2196c5674 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e6905c790>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:26.048413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.050517 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.056751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-349f9862-c88a-444f-970a-77a6c816fd89 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.378843 Feb 12 04:19:26.056751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 51/111] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:25 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:19:26.058059 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:26.058794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:26.065469 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.066087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.067043 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.067646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.136673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-32e7215d-febc-4aa1-9a6a-4ff2196c5674 tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103308 Feb 12 04:19:26.137710 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 61/112] 10.222.0.31 () {58 vars in 1187 bytes} [Sat Feb 12 04:19:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:26.142133 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:26.142747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:26.149712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.151127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.151927 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.152366 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.558903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.570028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.577355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8f9ec2fd-8851-4db7-b416-718d50aa1bc5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.438474 Feb 12 04:19:26.577973 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 62/113] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:26 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:26.582570 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6e602096-2984-4628-bc24-6515af9f9bf0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.528559 Feb 12 04:19:26.587624 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 52/114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:26 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:26.588541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-44cd860d-acbd-4d6b-bd4c-4125a4b687fa tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] Calling method '.version_select at 0x7f8e690f3c10>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:26.592905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:26.593541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:26.606525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.607754 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.608797 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:26.609486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:26.703140 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-44cd860d-acbd-4d6b-bd4c-4125a4b687fa tempest-VolumesTestJSON-485792756 tempest-VolumesTestJSON-485792756-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.119224 Feb 12 04:19:26.703784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 63/115] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 04:19:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:26.890533 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:26.903347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1bfc8319-de19-4692-b102-1d2ae2d601ac tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.313780 Feb 12 04:19:26.912692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 53/116] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:26 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:27.048798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:27.049700 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:27.058288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.058944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.060043 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.060942 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.072465 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:27.073088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:27.100982 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.102075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.106180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.106627 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.352441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:27.362628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6362414e-2a77-455d-b87b-a85c71baad8e tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.318563 Feb 12 04:19:27.363282 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 64/117] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:27 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:27.409838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:27.417795 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:27.419318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:27.426564 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-49292bf1-956e-4a92-9ff5-4ea6bcc10fe4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.358213 Feb 12 04:19:27.441085 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 54/118] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:27 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:19:27.473709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-8ac1c6dc-ad8f-4b03-a864-8f1173abe44c req-7fc12b8b-ae2f-4133-9f5e-4687a8ccaccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7", "tag": "781b9705-45e9-4f7b-a755-a236654ca737"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:27.475756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:27.475756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:27.490551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-8ac1c6dc-ad8f-4b03-a864-8f1173abe44c req-7fc12b8b-ae2f-4133-9f5e-4687a8ccaccf service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.492692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-8ac1c6dc-ad8f-4b03-a864-8f1173abe44c req-7fc12b8b-ae2f-4133-9f5e-4687a8ccaccf service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.506039 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-8ac1c6dc-ad8f-4b03-a864-8f1173abe44c req-7fc12b8b-ae2f-4133-9f5e-4687a8ccaccf service nova] Creating event network-changed:781b9705-45e9-4f7b-a755-a236654ca737 for instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 on hv-cinder-82869 Feb 12 04:19:27.512863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-8ac1c6dc-ad8f-4b03-a864-8f1173abe44c req-7fc12b8b-ae2f-4133-9f5e-4687a8ccaccf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Feb 12 04:19:27.513982 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 65/119] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:27.594994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:27.596038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:27.610975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:27.612216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:27.619567 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.620437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.624810 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.624810 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.625582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.626217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:27.627206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:27.630915 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.372340 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:28.382175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-be70ba69-a457-4ebc-bd8c-05574ecaafe1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.791009 Feb 12 04:19:28.383122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 55/120] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:27 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:28.388152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:28.389307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:28.389884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:28.397097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.398582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.400800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.404217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.404328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2eab014c-659d-4e73-b3c3-0e22fb0347f0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.799356 Feb 12 04:19:28.410262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 66/121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:27 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:28.415338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:28.416023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:28.423355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.424006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.424942 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.426083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.786704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:28.790096 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:28.796423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-94d902c3-b8a8-4e5f-95b8-cb9663e9e3e1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.412007 Feb 12 04:19:28.796998 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 56/122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:28 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:28.797712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9ab5f871-194e-4208-b018-fab2f0986a7d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.386269 Feb 12 04:19:28.798439 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 67/123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:28 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:28.801804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:28.802404 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:28.808879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.809492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:28.810401 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:28.810908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.026861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:29.035790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:29.037361 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:29.039086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-49d5ccf8-af59-4731-8d57-d4e6069af3f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.240135 Feb 12 04:19:29.039648 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 57/124] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:28 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:29.399810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:29.400520 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:29.406661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.407299 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.408406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.408836 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.421844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:29.422477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:29.428942 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.429646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.430452 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.430955 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.722456 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:29.728381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:29.731093 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ae608c5f-eb34-46ad-8f3b-df1f272cc763 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.313329 Feb 12 04:19:29.732049 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 58/125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:29 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:29.736600 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-db80e015-713d-4f07-b243-4e81c00605a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.341576 Feb 12 04:19:29.737184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 68/126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:29 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:29.813815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:29.814500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:29.815883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:29.817260 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:29.823605 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.824058 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.826233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.827293 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.827990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.828511 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:29.828877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:29.829613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.059979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:30.070997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:30.074431 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d659bb3f-2bed-48ab-93d4-0fedb899b333 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.258048 Feb 12 04:19:30.075053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 59/127] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:29 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:30.079642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:30.080237 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:30.084946 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6560b1cc-51b6-42b1-bff3-88ffe4399611 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.273606 Feb 12 04:19:30.085585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 69/128] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:29 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:30.087529 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.088243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.089225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.089912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.232300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:30.240198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:30.241782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:30.242956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0fc2f7b4-c059-467d-9472-1442b813e330 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.166757 Feb 12 04:19:30.243505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 60/129] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:30 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:30.567242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-da0011e1-f1da-45af-a50c-e03bf6ce060f req-444c0072-da06-4004-9373-6fa81b7667de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde7f41-c793-4cdd-b9ac-94923b7ab588", "name": "network-vif-plugged", "status": "completed", "tag": "1aa44ba5-96e3-4bef-be23-68c273fda544"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:30.568811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:30.568811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:30.586733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-da0011e1-f1da-45af-a50c-e03bf6ce060f req-444c0072-da06-4004-9373-6fa81b7667de service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.586733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-da0011e1-f1da-45af-a50c-e03bf6ce060f req-444c0072-da06-4004-9373-6fa81b7667de service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.592018 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-da0011e1-f1da-45af-a50c-e03bf6ce060f req-444c0072-da06-4004-9373-6fa81b7667de service nova] Creating event network-vif-plugged:1aa44ba5-96e3-4bef-be23-68c273fda544 for instance adde7f41-c793-4cdd-b9ac-94923b7ab588 on hv-cinder-82869 Feb 12 04:19:30.600444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-da0011e1-f1da-45af-a50c-e03bf6ce060f req-444c0072-da06-4004-9373-6fa81b7667de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093444 Feb 12 04:19:30.601185 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 70/130] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:30.749142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:30.750822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:30.756773 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:30.756933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.758143 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.758330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:30.758968 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.759553 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.767958 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.768801 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:30.770462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:30.771050 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.045797 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.058294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6f2ac7d4-54c2-4738-bc45-44138c43b42b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.313091 Feb 12 04:19:31.059138 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 61/131] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:30 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:31.077179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.088051 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-438f4324-f11e-4fad-901c-fd1c02a7a4a7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.336673 Feb 12 04:19:31.089102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 71/132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:30 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:31.091188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:31.091864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:31.098922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.103507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.104310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.104748 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.107264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:31.108363 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:31.115810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.117566 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.118583 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.119355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.403379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.409838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.410567 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-79d85290-c8eb-4273-9179-bbe039485e1a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.323180 Feb 12 04:19:31.411135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 62/133] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:31 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:31.416113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:31.416711 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:31.417898 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a69f9e7c-3dd6-4aba-820c-dc2474e4c8ef tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.316858 Feb 12 04:19:31.418452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 72/134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:31 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:31.422341 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.422781 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.423550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:31.423983 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:31.804723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.812823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.815045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:31.816248 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f820581e-eb01-4d9d-828c-7fee29e0c18d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.404114 Feb 12 04:19:31.816799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 63/135] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:31 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:32.074992 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:32.075616 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:32.081765 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.083678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.084521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.085624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.107825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:32.108443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:32.119217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.119217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.119217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.119217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.327380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:32.337869 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:32.338279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c5ad75b7-44da-4052-816d-0572ac136e4e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.267030 Feb 12 04:19:32.339017 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 73/136] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:32 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:32.365573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-316fc587-7425-4617-9d0a-5a082d1ef2a8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.261165 Feb 12 04:19:32.378339 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 64/137] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:32 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:32.430717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:32.431628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:32.434987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:32.435732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:32.441892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.442096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.442578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.443161 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.443714 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.444209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.445674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.446602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.651399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:32.658740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-65b3babc-73fd-417e-aba9-38cda0bbd03d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.228682 Feb 12 04:19:32.659300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 65/138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:32 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:32.663850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27b809-ac65-4266-99af-19350a4a9c03", "name": "network-vif-plugged", "status": "completed", "tag": "d5e20402-d3d7-4588-9215-82923e13decf"}, {"server_uuid": "30d39788-4a0a-4590-811a-bda70e802bc8", "name": "network-vif-plugged", "status": "completed", "tag": "28c9098c-2911-456c-a866-c46cf15a8c35"}, {"server_uuid": "91ffc43c-6075-4974-9b87-bed6a78914c3", "name": "network-vif-plugged", "status": "completed", "tag": "5d181d11-dd58-4c59-a93c-997e0ea1eb58"}, {"server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "name": "network-vif-plugged", "status": "completed", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:32.666010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:32.666010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:19:32.674610 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.675326 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.689226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:32.697867 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4db4ba28-e2e3-47d3-bce2-e00b64acb67e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1320 microversion: 2.1 time: 0.271014 Feb 12 04:19:32.698912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 74/139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:32 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:32.700622 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Creating event network-vif-plugged:d5e20402-d3d7-4588-9215-82923e13decf for instance 5d27b809-ac65-4266-99af-19350a4a9c03 on hv-cinder-82869 Feb 12 04:19:32.701127 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Creating event network-vif-plugged:28c9098c-2911-456c-a866-c46cf15a8c35 for instance 30d39788-4a0a-4590-811a-bda70e802bc8 on hv-cinder-82869 Feb 12 04:19:32.701648 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Creating event network-vif-plugged:5d181d11-dd58-4c59-a93c-997e0ea1eb58 for instance 91ffc43c-6075-4974-9b87-bed6a78914c3 on hv-cinder-82869 Feb 12 04:19:32.702137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] Creating event network-vif-plugged:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:19:32.711449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-bcc126a1-b6e7-44a5-99ae-c58c9c5b743b req-858060ff-b4ce-4f20-b30c-fd6571aab4f4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.050762 Feb 12 04:19:32.711953 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 66/140] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:32.837225 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:32.838182 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:32.846038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.846704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:32.848149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:32.848731 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.018002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:33.026618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:33.028144 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:33.029251 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e87eed01-5f41-40f9-bfeb-6e18bad57f94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.199496 Feb 12 04:19:33.030052 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 75/141] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:32 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:33.357458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:33.358765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:33.365215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.368971 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.368971 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.368971 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.381579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:33.382344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:33.392335 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.393024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.394033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.394806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.619985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:33.631789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-73cf0268-098c-4d41-b8ff-61d8b0f9a8fb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.279176 Feb 12 04:19:33.632763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 67/142] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:33 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:33.678118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:33.679506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:33.687321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.688437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.689943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.691100 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.713324 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:33.721096 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5485539c-7fdd-4ad4-b874-f5db57e10741 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.343138 Feb 12 04:19:33.721705 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 76/143] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:33 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:33.733951 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:33.736823 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:33.751147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.751601 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.752400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:33.752836 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:33.993345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.000613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b166e97f-4260-4d61-a08c-4849c508ae0d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.328951 Feb 12 04:19:34.001181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 68/144] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:33 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:34.008138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.018841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f6137da5-b81b-4bb9-8731-fdb6a10bfe9a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1513 microversion: 2.1 time: 0.294872 Feb 12 04:19:34.019663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 77/145] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:33 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:34.040591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:34.043161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:34.050553 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.051187 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.052152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.052855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.056757 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:34.058312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:34.068566 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.072900 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.073830 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.076296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.117782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'flavor' on Instance uuid adde7f41-c793-4cdd-b9ac-94923b7ab588 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:19:34.223628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.232528 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.234110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.235229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1a7360b7-c080-4c87-ad97-39f1e75e98ae tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.190185 Feb 12 04:19:34.235830 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 78/146] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:34 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:34.557888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6e6fedab-42a3-43c6-b0aa-2b64b25efcf5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588/action" status: 200 len: 32 microversion: 2.1 time: 0.514759 Feb 12 04:19:34.557888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 69/147] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:19:34 2022] POST /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:19:34.561983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:34.562761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:34.571308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.571899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.572756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.573317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.648453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:34.649137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:34.656665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.657342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.658289 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.658859 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.897251 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:34.905191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9b6b2b52-5476-4e78-b591-bd40deced11b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.347213 Feb 12 04:19:34.905792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 79/148] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:34 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:34.910128 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-ae35e81f-94c0-4253-9360-a855823b112a req-365b1301-8ad7-443f-8c0e-58836607f139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7", "name": "network-vif-plugged", "status": "completed", "tag": "781b9705-45e9-4f7b-a755-a236654ca737"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:34.911711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:34.911711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:34.918595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ae35e81f-94c0-4253-9360-a855823b112a req-365b1301-8ad7-443f-8c0e-58836607f139 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.919035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ae35e81f-94c0-4253-9360-a855823b112a req-365b1301-8ad7-443f-8c0e-58836607f139 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.932606 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-ae35e81f-94c0-4253-9360-a855823b112a req-365b1301-8ad7-443f-8c0e-58836607f139 service nova] Creating event network-vif-plugged:781b9705-45e9-4f7b-a755-a236654ca737 for instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 on hv-cinder-82869 Feb 12 04:19:34.937785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-ae35e81f-94c0-4253-9360-a855823b112a req-365b1301-8ad7-443f-8c0e-58836607f139 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Feb 12 04:19:34.938392 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 80/149] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:34.944149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:34.945427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:34.951728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.953448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:34.953448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:34.953448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.089593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.098268 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b00629ae-ce98-448a-8750-2b2eb8349436 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.453943 Feb 12 04:19:35.099407 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 70/150] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:34 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:35.115680 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:35.117540 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:35.129403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.131245 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.132921 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.135874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.344826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.353795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d8e2fe4a-c8b4-4651-b216-863a1392f5c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1318 microversion: 2.1 time: 0.413997 Feb 12 04:19:35.354361 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 81/151] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:34 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:35.358694 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:35.359297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:35.388895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.389750 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.390597 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.390954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.589577 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.598046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5715eee9-9de6-4031-be1a-889a996c81bf tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1314 microversion: 2.1 time: 0.497083 Feb 12 04:19:35.598750 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 71/152] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:35 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:35.680420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.689628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.691295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:35.692385 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-814ac984-e58d-4504-b16d-4e8f255e92c1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1407 microversion: 2.20 time: 0.337117 Feb 12 04:19:35.693101 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 82/153] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:35 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:19:35.931581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:35.932208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:35.938182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.938630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:35.939416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:35.939847 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.084260 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.092713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9a26edb7-3ac7-42c3-8e02-3d469820b298 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.174121 Feb 12 04:19:36.093315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 72/154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:35 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:36.114823 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:36.115432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:36.121688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.122584 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.123373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.123814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.257930 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.265260 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c6023bae-348d-46b7-9a25-6f084efd0ac2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1360 microversion: 2.1 time: 0.153939 Feb 12 04:19:36.275309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 83/155] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:36 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:36.371979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:36.372505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:36.378375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.378823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.379590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.380024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.541299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.547996 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f4e60c23-0940-4940-a695-5955e5821fee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1508 microversion: 2.1 time: 0.179907 Feb 12 04:19:36.548658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 73/156] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:36 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:36.616449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:36.618077 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:36.633798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.633798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.633798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.633798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.717837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:36.718466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:36.724248 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.725816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.725816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.726589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.782772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.792125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-30c2dd47-0292-43dd-b89f-f894c6c0c17f tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1501 microversion: 2.1 time: 0.180578 Feb 12 04:19:36.793073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 84/157] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:36 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:36.906443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.914558 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.916053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:36.917269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4abcb330-403c-4ad2-82e1-09b077f6d92c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1599 microversion: 2.20 time: 0.204986 Feb 12 04:19:36.917897 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 74/158] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:19:36 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1599 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:19:36.935467 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:36.936776 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:36.941979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.942461 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:36.943222 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:36.943646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.064932 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0a43a24d-dcc9-4d0c-ba47-fe6fd7ae19ef tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133311 Feb 12 04:19:37.065599 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 85/159] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 04:19:36 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:19:37.109981 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:37.111147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:37.117760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.118172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.119126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.119415 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.284584 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:37.285983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:37.298458 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.298963 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.299751 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.304481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.459823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:37.468604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e79f7cb4-411f-4e1a-8c7e-3b9ca827cfb7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.362928 Feb 12 04:19:37.469539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 75/160] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:37 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:37.813867 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:37.821474 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5d7bb20f-a26a-485b-bf94-3b019248e0b3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1547 microversion: 2.1 time: 0.541246 Feb 12 04:19:37.822135 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 86/161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:37 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1547 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:37.838759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:37.846307 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:37.853726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.854256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:37.855120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:37.855624 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.097446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fbb18404-6741-47ad-a628-5e38afed1e68 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262813 Feb 12 04:19:38.105797 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 76/162] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 04:19:37 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:38.462958 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c71215e-ea2b-4be3-b906-518d48c824be"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:38.464316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:38.470141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.470831 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.471581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.472066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.486503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:38.487587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:38.493748 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.494480 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.495483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.496147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.759518 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:38.767479 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ab20962a-39dc-4e8d-83b1-83512d482cfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.284529 Feb 12 04:19:38.768052 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 77/163] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:38 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:38.775381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf2de70a-af84-44f8-8508-8e90968b8ba5"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:38.776780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:38.783184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.783870 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:38.787277 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:38.787277 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.455141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-955f5f67-593b-433b-9f2d-16d6187d150b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996091 Feb 12 04:19:39.456106 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 87/164] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:19:38 2022] POST /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:39.462149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:39.463359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:39.470623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:39.471112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.471946 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:39.472327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.500294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-52c21994-2080-47b3-ae82-cc21df480f10 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/ips" status: 200 len: 112 microversion: 2.20 time: 0.042905 Feb 12 04:19:39.501692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 88/165] 10.222.0.31 () {60 vars in 1288 bytes} [Sat Feb 12 04:19:39 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/ips => generated 112 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:19:39.510840 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-2bb28bce-c81c-47fc-ab96-8e6247ba6e87 req-8732b8ea-a678-4d7f-bd19-46b7262fd915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:39.512681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:39.512681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:39.540232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-2bb28bce-c81c-47fc-ab96-8e6247ba6e87 req-8732b8ea-a678-4d7f-bd19-46b7262fd915 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:39.541156 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-2bb28bce-c81c-47fc-ab96-8e6247ba6e87 req-8732b8ea-a678-4d7f-bd19-46b7262fd915 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.571581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-2bb28bce-c81c-47fc-ab96-8e6247ba6e87 req-8732b8ea-a678-4d7f-bd19-46b7262fd915 service nova] Creating event network-changed:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:19:39.577035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-2bb28bce-c81c-47fc-ab96-8e6247ba6e87 req-8732b8ea-a678-4d7f-bd19-46b7262fd915 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073838 Feb 12 04:19:39.580165 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 89/166] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:39.786516 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:39.787565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:39.802729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:39.804676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.806773 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:39.807383 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:39.960555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-de6f7f58-946b-40c8-8a3f-82d4433d9cdd tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "POST /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.188447 Feb 12 04:19:39.961831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 78/167] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:19:38 2022] POST /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3/os-volume_attachments => generated 194 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:40.189360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:40.189360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:40.204885 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:40.207694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:40.220889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:40.220889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:40.278381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-72eb2610-c14a-4d36-bd3a-1e26c509cfa1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/ips" status: 200 len: 107 microversion: 2.1 time: 0.094048 Feb 12 04:19:40.280073 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 79/168] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:19:40 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/ips => generated 107 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:19:40.285333 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-47ebfa70-f758-4743-bb11-4d528218998b req-2842566f-90b7-4f0b-a50a-d493968c6df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7", "tag": "781b9705-45e9-4f7b-a755-a236654ca737"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:40.288172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:40.288172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:19:40.303415 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-47ebfa70-f758-4743-bb11-4d528218998b req-2842566f-90b7-4f0b-a50a-d493968c6df5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:40.304995 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-47ebfa70-f758-4743-bb11-4d528218998b req-2842566f-90b7-4f0b-a50a-d493968c6df5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:40.332372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-47ebfa70-f758-4743-bb11-4d528218998b req-2842566f-90b7-4f0b-a50a-d493968c6df5 service nova] Creating event network-changed:781b9705-45e9-4f7b-a755-a236654ca737 for instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 on hv-cinder-82869 Feb 12 04:19:40.338864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-47ebfa70-f758-4743-bb11-4d528218998b req-2842566f-90b7-4f0b-a50a-d493968c6df5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056324 Feb 12 04:19:40.339632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 80/169] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:40.391083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:40.400268 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-74bc9657-b39e-4c5a-9b9b-1e7c2a043e5d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.619168 Feb 12 04:19:40.402659 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 90/170] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:39 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:41.420016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:41.420802 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:41.436358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:41.436810 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:41.437746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:41.438339 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:41.618000 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:41.627310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a630ca72-26b1-42fc-b038-13b29ccf65a3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.210676 Feb 12 04:19:41.637956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 81/171] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:41 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:42.643667 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:42.644358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:42.651316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:42.651704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:42.652481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:42.652912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:42.841180 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:42.848719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4de5df8f-6304-447f-8dd4-db2bc5843e71 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.208668 Feb 12 04:19:42.849468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 91/172] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:42 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:44.066757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:44.066757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:44.066757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:44.066757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:44.067727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:44.067727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:44.067727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:44.068435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-df0b527d-bb55-4875-a466-a1df5bb9624a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.159028 Feb 12 04:19:44.068435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 82/173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:43 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:45.088883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:45.091697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:45.096066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:45.096517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:45.097323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:45.097793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:45.249390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:45.257353 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-90f26843-0c0f-4f1a-8137-19b10d8733ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.172522 Feb 12 04:19:45.257933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 92/174] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:45 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:46.274103 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:46.274730 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:46.281858 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:46.282592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:46.283728 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:46.284407 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:46.428238 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:46.435482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5143e444-63eb-4d04-91b0-f8aee472074a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.165862 Feb 12 04:19:46.439772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 83/175] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:46 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:47.451912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:47.452511 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:47.458670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:47.459110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:47.460501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:47.460931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:47.598795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:47.606355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1c59c6e7-e5fe-4268-922c-466202b3dcd8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.158022 Feb 12 04:19:47.607194 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 93/176] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:47 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:48.623577 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:48.624317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:48.630884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:48.632712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:48.632833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:48.633255 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:48.790597 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:48.798275 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-aab27bfa-7333-4018-b1b3-a616a3bfccd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.178410 Feb 12 04:19:48.798850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 84/177] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:48 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:49.815517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:49.816155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:49.822619 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:49.823004 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:49.823763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:49.824319 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:49.965538 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:49.973139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-31a68604-8c17-4e43-94c5-96e7d4ce8f90 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.161204 Feb 12 04:19:49.973870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 94/178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:49 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:50.191294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-778953599", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:50.265648 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] validate_networks() for [('5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:19:50.669655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:19:50.670075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:19:50.670782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:19:50.671170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:19:50.671578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:19:50.680413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:50.680856 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:50.681690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:50.682116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:50.698295 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:19:50.703589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for user e3609a9d4fe144b68a62ad4696301244 and project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:19:50.715097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:19:50.717435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:19:50.927408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-077d2e07-1c1f-425a-a48a-ac23b83d6ad5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740122 Feb 12 04:19:50.928316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 85/179] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:19:50.937806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6aefc103-86d9-406c-beac-ace99d3833ee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:50.938521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6aefc103-86d9-406c-beac-ace99d3833ee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:50.990865 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:50.992303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:50.996884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6aefc103-86d9-406c-beac-ace99d3833ee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:50.999806 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:51.000303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:51.001534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:51.002306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:51.003936 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6aefc103-86d9-406c-beac-ace99d3833ee tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1217 microversion: 2.1 time: 0.069685 Feb 12 04:19:51.004549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 95/180] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:50 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:51.179777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:51.187692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2869daad-9837-4bf4-bcce-7e692cded19f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.200878 Feb 12 04:19:51.191179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 86/181] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:50 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:52.021749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:52.022377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:52.029463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:52.029912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:52.035166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:52.035166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:52.092668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:52.101777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b4366e78-cf08-41b7-8075-c644e6df53d7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1221 microversion: 2.1 time: 0.083860 Feb 12 04:19:52.102336 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 96/182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:52 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:52.206891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:52.208089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:52.215182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:52.215628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:52.216479 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:52.216959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:52.358789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:52.366046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ec002686-f796-443f-afc7-c82a117f0059 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.162814 Feb 12 04:19:52.366606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 87/183] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:52 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:53.119774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:53.121971 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:53.129076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:53.129577 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:53.130352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:53.130782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:53.190017 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:53.197758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5e8f8eea-f940-4baa-801b-7c859af6489f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1269 microversion: 2.1 time: 0.083381 Feb 12 04:19:53.198318 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 97/184] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:53 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:53.381596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:53.384449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:53.388451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:53.388898 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:53.389871 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:53.390310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:53.534756 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:53.544702 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b42de40e-e96f-4c3f-9200-dba6df579175 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.166097 Feb 12 04:19:53.544887 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 88/185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:53 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:54.214479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:54.215171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:54.221335 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:54.221783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:54.222553 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:54.222982 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:54.284307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:54.292729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4284df92-e4c0-4b04-87d1-be4b6a2e14e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1269 microversion: 2.1 time: 0.081906 Feb 12 04:19:54.293311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 98/186] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:54 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:54.561592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:54.562198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:54.568325 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:54.568763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:54.569653 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:54.570077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:54.699027 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:54.706242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d2a9ff46-dfb6-4834-a947-12dffa5866df tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.148272 Feb 12 04:19:54.706801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 89/187] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:54 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:55.309714 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:55.310418 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:55.316623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:55.317066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:55.317865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:55.318294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:55.379514 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:55.387220 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3d3b01a6-9f3f-4f58-8987-92a00dc84006 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1269 microversion: 2.1 time: 0.081136 Feb 12 04:19:55.387780 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 99/188] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:55 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:55.722628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:55.723247 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:55.730187 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:55.730632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:55.731619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:55.731815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:55.862000 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:55.869893 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a13973ec-5a79-4b5d-a198-404be1b53ae2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.150863 Feb 12 04:19:55.870451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 90/189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:55 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:56.403676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:56.404280 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:56.410570 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:56.411013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:56.411781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:56.412211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:56.470502 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:56.478742 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9ddff468-60ba-403e-aa38-f0279cbcc87c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1269 microversion: 2.1 time: 0.078523 Feb 12 04:19:56.479308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 100/190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:56 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1269 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:56.887125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:56.888045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:56.894656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:56.902690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:56.902690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:56.902690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:57.042997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:57.050672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5dfa03ca-e4b7-4f67-bf27-7fc5ba371ee7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.167116 Feb 12 04:19:57.051426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 91/191] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:56 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:57.495475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:57.496062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:57.502314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:57.502756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:57.503585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:57.503940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:57.675681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:57.682967 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5437ea8a-b423-4761-8fb9-c7e5b3360eb4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.191687 Feb 12 04:19:57.683562 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 101/192] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:57 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:58.067393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:58.068958 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:58.085184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:58.085913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:58.087538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:58.088175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:58.223946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:58.233687 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3659576f-c225-4da2-be4f-d57386130b8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.169679 Feb 12 04:19:58.243942 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 92/193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:58 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:58.557494 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-331051ed-fd05-4541-98d4-467e3f0c0ae6 req-b715a37c-016d-4d2f-9124-1784c71c059f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfd8430-8109-4f4b-99f3-7d755f2849f0", "tag": "c91616f2-77ab-40c0-8485-6ee07fabecae"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:19:58.559682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:58.559682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:19:58.567109 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-331051ed-fd05-4541-98d4-467e3f0c0ae6 req-b715a37c-016d-4d2f-9124-1784c71c059f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:58.572049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-331051ed-fd05-4541-98d4-467e3f0c0ae6 req-b715a37c-016d-4d2f-9124-1784c71c059f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:58.578104 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-331051ed-fd05-4541-98d4-467e3f0c0ae6 req-b715a37c-016d-4d2f-9124-1784c71c059f service nova] Creating event network-changed:c91616f2-77ab-40c0-8485-6ee07fabecae for instance 2bfd8430-8109-4f4b-99f3-7d755f2849f0 on hv-cinder-82869 Feb 12 04:19:58.582835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-331051ed-fd05-4541-98d4-467e3f0c0ae6 req-b715a37c-016d-4d2f-9124-1784c71c059f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029520 Feb 12 04:19:58.583470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 102/194] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:19:58.700188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:58.700799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:58.707092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:58.707536 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:58.708319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:58.708902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:58.881037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:58.889717 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-16fee108-c35a-4acc-a64e-9e79dc3ab2d9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.193360 Feb 12 04:19:58.890293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 93/195] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:58 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:59.200893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:59.201627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:59.209269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.209828 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.210808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.211172 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.239216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:19:59.251318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:59.252182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:59.259116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.259563 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.260537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.261038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.432161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:59.444974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ce85095c-7801-40f8-aeb8-be27efe81649 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.197167 Feb 12 04:19:59.445602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 94/196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:59 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:19:59.577747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7b6dad75-3849-4e2f-9663-8fdd86f7f789 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "DELETE /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 204 len: 0 microversion: 2.1 time: 0.378788 Feb 12 04:19:59.577747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 103/197] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:19:59 2022] DELETE /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:19:59.584904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:59.585561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:59.591749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.592243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.593496 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.593949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.733251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:19:59.741113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7d9f54f0-2d4b-429c-a717-d955b96abfa5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1553 microversion: 2.1 time: 0.159889 Feb 12 04:19:59.741773 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 95/198] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:59 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:19:59.907579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:19:59.908262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:19:59.915159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.916514 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:19:59.916514 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:19:59.916801 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:00.050399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:00.058636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3282814a-1e55-4ebf-a555-798bd4668acf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.155136 Feb 12 04:20:00.059197 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 104/199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:19:59 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:00.462861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:00.463469 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:00.469760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:00.474523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:00.474523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:00.474523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:00.610242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:00.617738 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f7abc5ba-2c9e-4c40-8627-fb14fdbb4604 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.159009 Feb 12 04:20:00.618312 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 96/200] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:00 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:00.758444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:00.759096 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:00.765670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:00.766362 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:00.767151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:00.767748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:00.926020 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:00.927427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c88b2323-70af-4ba7-a61c-2bc9acde8893 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1553 microversion: 2.1 time: 0.173681 Feb 12 04:20:00.938321 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 105/201] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:00 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:01.074281 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:01.074893 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:01.080568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.081016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:01.081816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.082267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:01.219395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:01.226693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b5258ec9-87b7-4ed1-9478-760e18447029 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.155991 Feb 12 04:20:01.227255 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 97/202] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:01 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:01.635018 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:01.635719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:01.647311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.649523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:01.649523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.653307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:01.851031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:01.859412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0febf7ab-0643-423d-afa5-a0cffdd3eb48 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.228740 Feb 12 04:20:01.869640 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 106/203] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:01 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:01.944470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:01.946403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:01.954656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.955322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:01.956369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:01.956926 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.116626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:02.124912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cc8a3947-1c43-4031-8b59-89186c561453 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1553 microversion: 2.1 time: 0.184413 Feb 12 04:20:02.125501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 98/204] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:01 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:02.244454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:02.245196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:02.251297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:02.251747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.252530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:02.252965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.470186 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:02.480262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0169ff8a-ce14-4664-bf1b-35a4f83e675b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.240036 Feb 12 04:20:02.489578 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 107/205] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:02 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:02.880350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:02.881835 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:02.891439 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:02.892347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.893370 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:02.894672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.926859 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-74c3f368-f37b-4777-9ce9-00d2a6d5daf8 req-4fd2a7a7-1e60-458f-b2ed-9b9aa54af674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ffc43c-6075-4974-9b87-bed6a78914c3", "name": "network-vif-deleted", "tag": "5d181d11-dd58-4c59-a93c-997e0ea1eb58"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:02.929426 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:20:02.929426 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:20:02.937646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-74c3f368-f37b-4777-9ce9-00d2a6d5daf8 req-4fd2a7a7-1e60-458f-b2ed-9b9aa54af674 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:02.938093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-74c3f368-f37b-4777-9ce9-00d2a6d5daf8 req-4fd2a7a7-1e60-458f-b2ed-9b9aa54af674 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:02.954420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-74c3f368-f37b-4777-9ce9-00d2a6d5daf8 req-4fd2a7a7-1e60-458f-b2ed-9b9aa54af674 service nova] Creating event network-vif-deleted:5d181d11-dd58-4c59-a93c-997e0ea1eb58 for instance 91ffc43c-6075-4974-9b87-bed6a78914c3 on hv-cinder-82869 Feb 12 04:20:02.959445 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-74c3f368-f37b-4777-9ce9-00d2a6d5daf8 req-4fd2a7a7-1e60-458f-b2ed-9b9aa54af674 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 Feb 12 04:20:02.960902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 108/206] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:03.051422 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:03.061692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-04795f03-78e5-4021-b84f-9cb534306e0b tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.188099 Feb 12 04:20:03.062270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 99/207] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:02 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:03.146265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:03.147164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:03.153743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:03.154192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:03.154965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:03.155405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:03.225097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:03.233258 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ca5691ad-4e69-40fc-a173-d79f1010620d tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1345 microversion: 2.1 time: 0.090980 Feb 12 04:20:03.233842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 109/208] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:03 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:03.496280 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:03.497159 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:03.504259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:03.504908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:03.505770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:03.506202 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:03.646307 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:03.659276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a91f145d-d264-42c4-8b09-d921c15f6547 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.167049 Feb 12 04:20:03.659858 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 100/209] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:03 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:04.078948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-7741eaac-7b5e-4a95-8095-f97f78e2e6e3 req-cfea2ab8-d508-4313-95be-3863f427b9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfd8430-8109-4f4b-99f3-7d755f2849f0", "name": "network-vif-plugged", "status": "completed", "tag": "c91616f2-77ab-40c0-8485-6ee07fabecae"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:04.087446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:04.088063 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:04.089779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:20:04.089779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:20:04.096896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-7741eaac-7b5e-4a95-8095-f97f78e2e6e3 req-cfea2ab8-d508-4313-95be-3863f427b9c2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.103722 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.104169 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.104956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.105423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.108792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-7741eaac-7b5e-4a95-8095-f97f78e2e6e3 req-cfea2ab8-d508-4313-95be-3863f427b9c2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.121973 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-7741eaac-7b5e-4a95-8095-f97f78e2e6e3 req-cfea2ab8-d508-4313-95be-3863f427b9c2 service nova] Creating event network-vif-plugged:c91616f2-77ab-40c0-8485-6ee07fabecae for instance 2bfd8430-8109-4f4b-99f3-7d755f2849f0 on hv-cinder-82869 Feb 12 04:20:04.128492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-7741eaac-7b5e-4a95-8095-f97f78e2e6e3 req-cfea2ab8-d508-4313-95be-3863f427b9c2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052634 Feb 12 04:20:04.131047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 110/210] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:04.250825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:04.251620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:04.259129 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.259690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.260575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.261118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.266208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:04.274735 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-dbf589cc-fec5-481d-9ba9-b3b5bc45f6f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.191396 Feb 12 04:20:04.281318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 101/211] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:04 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:04.301519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.303838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.303838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lazy-loading 'fault' on Instance uuid 91ffc43c-6075-4974-9b87-bed6a78914c3 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:20:04.354526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e830b3807c421e9039bb78a42c393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f11a00f62cf540c79ea14b02953dfd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:04.364000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0e3f1b77-5737-4578-b643-4be5319d6fd5 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 200 len: 1350 microversion: 2.1 time: 0.117223 Feb 12 04:20:04.365365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 111/212] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:04 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:04.675973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:04.676644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:04.682711 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.683157 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.686094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:04.686094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:04.818536 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:04.826389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-90a1cb99-160d-4d86-a9fe-4b31fb458101 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.154027 Feb 12 04:20:04.826955 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 102/213] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:04 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:05.292571 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:05.293184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:05.300006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.300470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.301237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.301712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.381761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:05.382596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:05.389363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.389967 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.391102 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.391749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.406985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] HTTP exception thrown: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. Feb 12 04:20:05.407684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Returning 404 to user: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:05.408592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f0a70e40-b376-4096-9114-f7f13e9ae6d8 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 404 len: 111 microversion: 2.1 time: 0.030940 Feb 12 04:20:05.409220 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 103/214] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:05 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:20:05.438559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:05.446314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5de5cc32-284f-4ac7-ac95-676b2e8d1e01 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.158024 Feb 12 04:20:05.446879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 112/215] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:05 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:05.520984 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:05.522109 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:05.528644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.528644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.529332 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.529762 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.542601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] HTTP exception thrown: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. Feb 12 04:20:05.543175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Returning 404 to user: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:05.543977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7ca96fb3-24c8-4812-808b-43a41b7c3594 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026909 Feb 12 04:20:05.544543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 104/216] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:05 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:20:05.844071 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:05.844684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:05.850748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.851880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.852574 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:05.853072 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:05.987746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:05.995390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-28d692fd-df6c-41f3-a14f-2b30c8488182 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.155412 Feb 12 04:20:05.996022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 113/217] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:05 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:06.463054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:06.463667 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:06.469977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:06.470414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:06.471191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:06.471634 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:06.604584 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:06.611964 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-127c5231-f1e1-4851-ac40-fcff502d72f5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.152684 Feb 12 04:20:06.612529 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 105/218] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:06 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:07.011798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:07.012327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:07.018788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:07.019233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:07.020007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:07.020438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:07.157671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:07.165399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3ca3d6bf-7265-4005-ae16-c04e74e03616 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1317 microversion: 2.1 time: 0.157375 Feb 12 04:20:07.165960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 114/219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:07 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:07.629185 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:07.629814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:07.637458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:07.637908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:07.638720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:07.639155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:07.775179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:07.782959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-81b30d7d-85fb-4748-adf4-0140c30daa79 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.157436 Feb 12 04:20:07.789438 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 106/220] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:07 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:08.181693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:08.182375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:08.188848 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.189304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.190076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.190531 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.322739 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:08.329879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-85f250a9-cb7d-462a-8a7d-7b318f0ea689 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1507 microversion: 2.1 time: 0.151964 Feb 12 04:20:08.330432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 115/221] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:08 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:08.346651 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c71215e-ea2b-4be3-b906-518d48c824be"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:08.347734 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:08.353790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.354229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.354991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.355421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.428876 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Invalid volume: volume 5c71215e-ea2b-4be3-b906-518d48c824be is already attached to instances: 30d39788-4a0a-4590-811a-bda70e802bc8 Feb 12 04:20:08.429528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 400 to user: Invalid volume: volume 5c71215e-ea2b-4be3-b906-518d48c824be is already attached to instances: 30d39788-4a0a-4590-811a-bda70e802bc8 {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:08.430351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a63d0159-f4f1-4b0b-b432-3aa5b24715d6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.087868 Feb 12 04:20:08.430889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 107/222] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:20:08 2022] POST /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:20:08.487409 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:08.487900 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:08.493621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.494072 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.494839 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.495276 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.750795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'services' on Instance uuid 30d39788-4a0a-4590-811a-bda70e802bc8 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:20:08.800709 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:08.801343 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:08.808304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.808880 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.809685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:08.810120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:08.942740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:08.950701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b6828cbb-b097-45b9-b5ce-5ba7877fb62f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.153606 Feb 12 04:20:08.951259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 108/223] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:08 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:09.083866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-44e1c644-86ae-4b7b-83c1-bb9600b6806e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments/5c71215e-ea2b-4be3-b906-518d48c824be" status: 202 len: 0 microversion: 2.1 time: 0.599927 Feb 12 04:20:09.084461 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 116/224] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:20:08 2022] DELETE /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments/5c71215e-ea2b-4be3-b906-518d48c824be => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:20:09.092821 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:09.093765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:09.103778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:09.103778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:09.103778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:09.103778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:09.133331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7e278bc2-7edb-4484-9ec5-2f989dbfb5fd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Feb 12 04:20:09.133884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 109/225] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:09 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:09.968382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:09.969000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:09.975197 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:09.975644 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:09.976416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:09.976855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.109724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:10.117653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d4442c95-cb60-4451-bf91-ab9d1e461bc1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.153839 Feb 12 04:20:10.118215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 117/226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:09 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:10.144770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:10.145710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:10.158819 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.159262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.160119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.162322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.193106 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bda4112d-24bd-4615-a360-500a8b0419a5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052240 Feb 12 04:20:10.193712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 110/227] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:10 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:10.268102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:10.268743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:10.274817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.291426 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.292651 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.295693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.330147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] HTTP exception thrown: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. Feb 12 04:20:10.330762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Returning 404 to user: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:10.331555 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c5cd9329-ce22-4270-bcb0-69ea7d8dc2b9 tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "DELETE /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 404 len: 111 microversion: 2.1 time: 0.067157 Feb 12 04:20:10.333614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 118/228] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:20:10 2022] DELETE /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:20:10.345912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:10.346524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] [instance: 91ffc43c-6075-4974-9b87-bed6a78914c3] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:10.352690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.353656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.354715 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:10.355318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:10.371187 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] HTTP exception thrown: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. Feb 12 04:20:10.371820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] Returning 404 to user: Instance 91ffc43c-6075-4974-9b87-bed6a78914c3 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:10.372887 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4a9ad84f-97d4-488d-846b-45742e9da70c tempest-DeleteServersTestJSON-2125704474 tempest-DeleteServersTestJSON-2125704474-project] 10.222.0.31 "GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3" status: 404 len: 111 microversion: 2.1 time: 0.030822 Feb 12 04:20:10.373366 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 111/229] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:10 2022] GET /compute/v2.1/servers/91ffc43c-6075-4974-9b87-bed6a78914c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:20:11.134248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:11.134933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:11.141252 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.141720 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.142487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.142917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.208165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:11.209622 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:11.232739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.233554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.238315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.238315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.293026 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-353b5b76-4c2f-467f-8dc6-1e0dbbb1c733 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090772 Feb 12 04:20:11.293854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 112/230] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:11 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:20:11.317947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:11.326268 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8c6e6cc2-de52-424d-81da-a3b31508acee tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.195657 Feb 12 04:20:11.327396 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 119/231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:11 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:11.456096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1542694541", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:11.507890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] validate_networks() for [('5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:20:11.865131 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:20:11.865614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:20:11.866085 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:20:11.866496 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:20:11.866909 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:20:11.875370 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.875816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.876626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:11.877062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:11.894291 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:20:11.899149 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for user e3609a9d4fe144b68a62ad4696301244 and project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:20:11.910189 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:20:11.912365 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:20:12.050711 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c44f6944-ad04-419b-a94c-058ae38b3e31 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598263 Feb 12 04:20:12.051641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 113/232] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:20:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:20:12.062808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-65fedc60-ce78-48b3-874c-96561683c940 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:12.063632 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-65fedc60-ce78-48b3-874c-96561683c940 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:12.151363 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-65fedc60-ce78-48b3-874c-96561683c940 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:12.160660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-65fedc60-ce78-48b3-874c-96561683c940 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1218 microversion: 2.1 time: 0.102048 Feb 12 04:20:12.162068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 120/233] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:12 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:12.344208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:12.344917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:12.350936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:12.351453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:12.352299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:12.352863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:12.505492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:12.513746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fc62b96c-d1f2-4549-8062-30ec5aa95eef tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.173618 Feb 12 04:20:12.514483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 114/234] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:12 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:13.179279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:13.179916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:13.187405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:13.187852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:13.188633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:13.190770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:13.259432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:13.266859 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-040a5608-3a66-4278-b785-dd3bdabba7c8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1222 microversion: 2.1 time: 0.091382 Feb 12 04:20:13.267400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 121/235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:13 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:13.530433 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:13.531037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:13.537150 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:13.537633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:13.538956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:13.539380 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:13.671319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:13.678841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-956f2750-8fee-4b30-a2dd-54f5e8ac4426 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.151965 Feb 12 04:20:13.679392 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 115/236] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:13 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:14.284359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:14.284957 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:14.291847 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:14.292288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:14.293061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:14.293568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:14.353763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:14.360783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-99ea727f-1adc-4d98-b703-5be337f1aa7d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1214 microversion: 2.1 time: 0.080381 Feb 12 04:20:14.361397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 122/237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:14 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:14.696600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:14.697214 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:14.711962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:14.711962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:14.711962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:14.711962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:14.863119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:14.871240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e95060b0-8f0e-4ec9-b8d1-791722490c92 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.179210 Feb 12 04:20:14.871811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 116/238] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:14 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:15.379975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:15.380745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:15.388428 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:15.422745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:15.422745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:15.422745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:15.450736 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:15.458011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-aaa680ce-a45c-40a6-87bb-c22bbd9b1760 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1278 microversion: 2.1 time: 0.083869 Feb 12 04:20:15.458597 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 123/239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:15 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1278 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:15.887967 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:15.888574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:15.894749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:15.895201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:15.895966 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:15.896393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:16.036394 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:16.044475 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-92ad0ed0-c922-4a51-a5db-78a1b7d4839e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.160275 Feb 12 04:20:16.044972 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 117/240] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:15 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:16.475482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:16.476742 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:16.483266 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:16.484332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:16.484464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:16.484864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:16.620945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:16.628086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-184e8b55-b711-4d64-b50b-6d32319ca333 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.156265 Feb 12 04:20:16.628635 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 124/241] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:16 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:17.061052 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:17.061688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:17.067904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:17.068350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:17.069117 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:17.070096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:17.202147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:17.209500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-dd1df3f3-93b8-4215-b328-45c7ac9e3f29 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.152040 Feb 12 04:20:17.210066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 118/242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:17 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:17.644703 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:17.645331 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:17.651601 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:17.652073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:17.652840 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:17.653287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:17.782400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:17.789735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fe6d5b6d-ea9c-4c18-87f1-06e5ad42b7e4 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.148578 Feb 12 04:20:17.790291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 125/243] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:17 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:18.227021 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:18.237194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:18.237194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:18.237194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:18.237194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:18.237623 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:18.406964 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:18.419669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7508d8cf-73a8-41de-8d88-f43eb10eb4cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.196700 Feb 12 04:20:18.447915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 119/244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:18 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:18.811204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:18.811824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:18.818234 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:18.830350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:18.830350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:18.830350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:18.962640 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:18.974264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1ceaf96c-1524-4316-8d98-64861007fa7e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.170133 Feb 12 04:20:18.974928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 126/245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:18 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:19.182399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-3a471171-7ea3-4718-a69b-88ae39b6b9cd req-5067f372-303c-4ba4-a177-54ee909da3be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d4c38d-1d35-40ba-90ca-76a76103873e", "tag": "0aa7da43-7d38-403e-96e1-faec6f576040"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:19.184646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:20:19.184646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:20:19.191680 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-3a471171-7ea3-4718-a69b-88ae39b6b9cd req-5067f372-303c-4ba4-a177-54ee909da3be service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:19.192123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-3a471171-7ea3-4718-a69b-88ae39b6b9cd req-5067f372-303c-4ba4-a177-54ee909da3be service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:19.205004 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-3a471171-7ea3-4718-a69b-88ae39b6b9cd req-5067f372-303c-4ba4-a177-54ee909da3be service nova] Creating event network-changed:0aa7da43-7d38-403e-96e1-faec6f576040 for instance c8d4c38d-1d35-40ba-90ca-76a76103873e on hv-cinder-82869 Feb 12 04:20:19.210981 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-3a471171-7ea3-4718-a69b-88ae39b6b9cd req-5067f372-303c-4ba4-a177-54ee909da3be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034691 Feb 12 04:20:19.212794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 120/246] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:19.439836 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:19.440708 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:19.453827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:19.453827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:19.453827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:19.453827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:19.634496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:19.644112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f5157856-8560-464b-b5ff-d48882e045b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.207976 Feb 12 04:20:19.644712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 127/247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:19 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:19.999801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:20.006077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:20.013616 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:20.014625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:20.016051 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:20.017161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:20.176761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:20.185744 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d4133015-3a3c-4e68-a456-63cf58ae4b75 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.194990 Feb 12 04:20:20.186320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 121/248] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:19 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:20.662145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:20.662884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:20.669758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:20.670208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:20.670993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:20.671417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:20.829705 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:20.837788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-12003ef2-a3a3-4fa5-a767-013cb146a2b8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.179420 Feb 12 04:20:20.838347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 128/249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:20 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:21.202387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:21.202984 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:21.209446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:21.209885 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:21.210858 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:21.211282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:21.573451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:21.580702 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4a98912a-6559-4ab7-b72f-9a489cf04559 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.382195 Feb 12 04:20:21.581198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 122/250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:21 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:21.854892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:21.855420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:21.861680 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:21.862131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:21.862908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:21.863354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:22.016307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:22.024584 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5a0f7c4f-5a1a-480b-a75a-60a8e19826b4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.173997 Feb 12 04:20:22.025322 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 129/251] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:21 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:22.597715 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:22.598357 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:22.605033 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:22.605587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:22.606346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:22.606782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:22.749072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:22.756352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d43bb367-44bb-4b05-b579-226d4e418cd6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.162313 Feb 12 04:20:22.757477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 123/252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:22 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:23.041812 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:23.042426 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:23.049002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:23.049496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:23.050292 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:23.050751 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:23.198015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:23.205487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-02f387dd-4554-4cb8-871e-df22d1d3363d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.167880 Feb 12 04:20:23.206068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 130/253] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:23 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:23.774782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:23.775505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:23.781969 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:23.782420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:23.783180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:23.783614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:23.916055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:23.923492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3a7d9f02-a1da-4474-9357-2e863344870b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.152942 Feb 12 04:20:23.924060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 124/254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:23 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:24.221860 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:24.222509 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:24.229616 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:24.230064 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:24.230852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:24.231288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:24.369987 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:24.377326 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5d31c706-719d-4fe2-84e7-452b4958b2d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.159200 Feb 12 04:20:24.378062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 131/255] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:24 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:24.939792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:24.940384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:24.948176 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:24.948626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:24.949419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:24.950036 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:25.090535 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:25.098349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c5fa573d-f437-4d1c-a147-646404c31585 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.162006 Feb 12 04:20:25.098754 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 125/256] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:24 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:25.393888 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:25.394506 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:25.401176 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:25.401652 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:25.402645 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:25.403087 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:25.559724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:25.567356 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-01e3d829-96ba-4fb7-b8bf-18ac6bd201be tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.176996 Feb 12 04:20:25.568049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 132/257] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:25 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:26.114983 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:26.115933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:26.124301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:26.125539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:26.131941 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:26.136988 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:26.299406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:26.306655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-031f74ae-bdd0-45cb-9236-9d866b80115e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.195259 Feb 12 04:20:26.307217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 126/258] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:26 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:26.584059 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:26.586086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:26.592502 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:26.593167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:26.593981 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:26.594585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:26.727002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:26.734760 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-47687acb-cf31-4d62-bd3f-9d37f9bd01c1 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1519 microversion: 2.1 time: 0.154459 Feb 12 04:20:26.735339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 133/259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:26 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:27.325646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:27.326332 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:27.332308 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.332757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:27.333556 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.333993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:27.467864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:27.481047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ad4ecf55-71b9-47b0-a2fa-e088cfa3f6dc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.159305 Feb 12 04:20:27.481661 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 127/260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:27 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:27.752257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:27.753160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:27.760209 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.760844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:27.761716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.762348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:27.900179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:27.907790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-278d111f-4e98-4f2f-a395-8d8662aafcf9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1499 microversion: 2.1 time: 0.159371 Feb 12 04:20:27.908342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 134/261] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:27 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:27.924253 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:27.924861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:27.930648 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.933259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:27.933259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:27.933259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:28.071606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:28.080832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6cf18133-73d7-4a7d-937b-8a4009069a09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1515 microversion: 2.1 time: 0.160242 Feb 12 04:20:28.093010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 128/262] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:27 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:28.497466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:28.498067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:28.504048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:28.504489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:28.505249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:28.505700 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:28.644836 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-55c5f71c-7d79-4e05-830f-d647581d77e9 req-51b33dcf-d4f3-4b07-9b10-3de3fbd6b9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4c38d-1d35-40ba-90ca-76a76103873e", "name": "network-vif-plugged", "status": "completed", "tag": "0aa7da43-7d38-403e-96e1-faec6f576040"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:28.646487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:20:28.646487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:20:28.655854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-55c5f71c-7d79-4e05-830f-d647581d77e9 req-51b33dcf-d4f3-4b07-9b10-3de3fbd6b9ea service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:28.656299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-55c5f71c-7d79-4e05-830f-d647581d77e9 req-51b33dcf-d4f3-4b07-9b10-3de3fbd6b9ea service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:28.663687 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:28.668304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d366d8b0-f1b3-4fcc-acde-4f6152cbea63 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.174471 Feb 12 04:20:28.668879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 135/263] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:28 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:28.669022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-55c5f71c-7d79-4e05-830f-d647581d77e9 req-51b33dcf-d4f3-4b07-9b10-3de3fbd6b9ea service nova] Creating event network-vif-plugged:0aa7da43-7d38-403e-96e1-faec6f576040 for instance c8d4c38d-1d35-40ba-90ca-76a76103873e on hv-cinder-82869 Feb 12 04:20:28.674405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-55c5f71c-7d79-4e05-830f-d647581d77e9 req-51b33dcf-d4f3-4b07-9b10-3de3fbd6b9ea service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034003 Feb 12 04:20:28.675066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 129/264] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:29.685654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:29.686266 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:29.692617 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:29.693064 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:29.693873 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:29.694354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:29.824758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:29.832380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f4acf6d0-7c08-4135-8c9e-229e8858829d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.150457 Feb 12 04:20:29.832954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 136/265] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:29 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:30.057582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:30.058685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:30.065064 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.065543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:30.066315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.066740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:30.090139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'flavor' on Instance uuid 5d27b809-ac65-4266-99af-19350a4a9c03 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:20:30.671814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-73653138-fae8-40fb-ab8e-6a32fbccd606 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action" status: 200 len: 32 microversion: 2.1 time: 0.619206 Feb 12 04:20:30.673116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 130/266] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:20:30 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action => generated 32 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:20:30.682774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:30.683373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:30.689945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.690536 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:30.691171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.691610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:30.848610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:30.849270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:30.850046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:30.858304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5509cfba-2da2-4dac-bd1c-3de2c4c84b75 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.179767 Feb 12 04:20:30.859388 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 137/267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:30 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:30.863153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.863598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:30.864535 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:30.864976 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:31.028275 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:31.036703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-68911197-4ee3-4021-a683-8708447dccdc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1318 microversion: 2.1 time: 0.191819 Feb 12 04:20:31.037902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 131/268] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:30 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:31.875496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:31.876064 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:31.883682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:31.884066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:31.884856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:31.885263 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:32.026688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:32.029510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a052563f-a54e-4421-8b2e-85abeb50f5af tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.158051 Feb 12 04:20:32.030227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 138/269] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:31 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:32.054372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:32.055124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:32.061357 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:32.061804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:32.062578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:32.063084 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:32.199128 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:32.206878 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2f4b35f7-3710-48cd-905a-8c2157f538e9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1508 microversion: 2.1 time: 0.156521 Feb 12 04:20:32.207625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 132/270] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:32 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:33.047643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:33.048525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:33.056308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:33.059171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:33.059171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:33.059171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:33.191096 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:33.198352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-581754b2-e11e-4a16-a69d-4627f534c2a4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.155303 Feb 12 04:20:33.198915 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 139/271] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:33 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:34.215086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:34.215828 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:34.222462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:34.222875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:34.223715 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:34.224150 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:34.381060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:34.385566 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f5e0a7-86da-4ed8-8a26-a10611103ca2"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:34.389503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-230bc92c-f91a-4eae-af73-ba0a7c059d84 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.178102 Feb 12 04:20:34.391381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 133/272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:34 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:34.391773 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:34.423910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:34.424524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:34.425442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:34.425910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:35.407265 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:35.407991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:35.414507 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:35.415222 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:35.416049 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:35.416487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:35.517175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a57cda95-904a-4a73-af1b-608bed8407a1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137768 Feb 12 04:20:35.518438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 140/273] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:20:34 2022] POST /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:20:35.719785 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:35.727662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9929133b-9be2-4f14-be01-ea980515e7cd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.323955 Feb 12 04:20:35.728165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 134/274] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:35 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:36.768746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:36.768746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:36.768746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:36.768746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:36.770034 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:36.770034 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:36.957790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:36.969787 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0d44a696-9919-4923-8724-c8c1d805f930 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.224942 Feb 12 04:20:36.980933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 141/275] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:36 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:37.988037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:37.989337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:37.996628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:37.997434 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:37.998445 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:37.998875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:38.179593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:38.183829 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f7182050-0dfa-4c0c-8e48-a06476d31f96 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.199776 Feb 12 04:20:38.184420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 135/276] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:37 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:39.199711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:39.200959 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:39.207399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:39.207880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:39.208650 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:39.209093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:39.398077 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:39.405431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f92fcea9-da71-4db7-bf65-9f1288ab4381 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.209349 Feb 12 04:20:39.408923 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 142/277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:39 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:40.424604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:40.425809 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:40.435713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:40.437136 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:40.438998 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:40.443071 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:40.643950 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:40.652134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-56575f6b-bcbc-46c7-bac1-0c7546263016 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.231560 Feb 12 04:20:40.652992 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 136/278] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:40 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:41.669405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:41.670080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:41.676321 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:41.676993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:41.677810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:41.678257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:41.864718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:41.874565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1da48cb3-e57d-432c-b7bd-c45fec7594ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.208253 Feb 12 04:20:41.875226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 143/279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:41 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:42.911385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:42.911385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:42.911385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:42.911385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:42.914442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:42.914442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:43.182141 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:43.191262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ce63a709-6d8e-4402-9dac-74d0f3663288 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.303118 Feb 12 04:20:43.191873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 137/280] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:42 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:44.210108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:44.210709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:44.221391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:44.221982 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:44.223115 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:44.223573 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:44.392963 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:44.404134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4eeb03cb-d31b-4bb8-8742-2aae607352bf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.197730 Feb 12 04:20:44.409338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 144/281] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:44 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:45.422888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:45.427716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:45.459191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.463025 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:45.465786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.467874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:45.656498 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:45.670531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-99febc85-3c0d-4248-8e8f-dffa33534a0e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1501 microversion: 2.1 time: 0.251638 Feb 12 04:20:45.671112 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 138/282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:45 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:45.690144 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f96a778-78ff-40de-ad4d-4b9f557ba27f"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:45.691340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:45.698423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.698869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:45.699704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.700139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:45.747961 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] HTTP exception thrown: Cannot 'attach_volume' instance 5d27b809-ac65-4266-99af-19350a4a9c03 while it is in vm_state rescued Feb 12 04:20:45.748640 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Returning 409 to user: Cannot 'attach_volume' instance 5d27b809-ac65-4266-99af-19350a4a9c03 while it is in vm_state rescued {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:45.749525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0eba97c1-cea8-42e7-a8c4-5db85969a3ea tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065777 Feb 12 04:20:45.753325 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 145/283] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:20:45 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 04:20:45.763891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:45.764488 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:45.773359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.773924 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:45.774815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:45.775344 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:46.123667 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-debd1e2f-267f-4cbc-8197-95db50f465db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action" status: 202 len: 0 microversion: 2.1 time: 0.368284 Feb 12 04:20:46.127423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 139/284] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:20:45 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:20:46.134291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:46.135309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:46.144779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:46.145360 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:46.146529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:46.147117 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:46.330249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:46.347847 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-882c422e-76ad-49fe-836d-8eda9378c4a5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1509 microversion: 2.1 time: 0.218989 Feb 12 04:20:46.348441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 146/285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:46 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:47.385864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:47.386397 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:47.393468 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:47.398807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:47.398807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:47.398807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:47.616904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:47.627518 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e5527e51-a1ce-49c7-88a3-9b20e48361d5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1509 microversion: 2.1 time: 0.255494 Feb 12 04:20:47.641991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 140/286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:47 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:48.648339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:48.649701 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:48.660594 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:48.664256 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:48.666501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:48.668379 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:48.880834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:48.890613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3a289ea5-7156-487f-8d14-d2e9e18d1053 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1509 microversion: 2.1 time: 0.247527 Feb 12 04:20:48.891730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 147/287] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:48 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:49.908010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:49.909316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:49.916720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:49.917632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:49.918631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:49.919251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:50.146478 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:50.163100 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-07db7881-611f-491d-af33-8a4ac44223f9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1515 microversion: 2.1 time: 0.257109 Feb 12 04:20:50.184350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 141/288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:49 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:57.651686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:57.652296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:57.663510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.664213 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.665515 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.666133 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.766363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f5e0a7-86da-4ed8-8a26-a10611103ca2"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:57.767448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:57.776642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.777098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.780693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.781309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.835308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:57.845551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5674ade3-4c18-4601-bb97-7fcae9ddfb8a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1515 microversion: 2.1 time: 0.197471 Feb 12 04:20:57.851062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 148/289] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:57 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:20:57.868983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bb7741f-4b4d-4cfb-97b4-cc6794fbbb9c"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:57.870286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:57.881963 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.882476 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.883745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.884275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.896413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Invalid volume: volume 52f5e0a7-86da-4ed8-8a26-a10611103ca2 is already attached to instances: c8d4c38d-1d35-40ba-90ca-76a76103873e Feb 12 04:20:57.897804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 400 to user: Invalid volume: volume 52f5e0a7-86da-4ed8-8a26-a10611103ca2 is already attached to instances: c8d4c38d-1d35-40ba-90ca-76a76103873e {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:20:57.902113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5376fbf0-5fce-49f6-8e7b-855878d873e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139492 Feb 12 04:20:57.907716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 142/290] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:20:57 2022] POST /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 04:20:57.975787 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:57.976379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:57.982674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.983231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:57.984078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:57.984515 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:58.107360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'services' on Instance uuid c8d4c38d-1d35-40ba-90ca-76a76103873e {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:20:58.386456 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-42a63d76-1c9e-4764-aab3-673559aea926 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments/52f5e0a7-86da-4ed8-8a26-a10611103ca2" status: 202 len: 0 microversion: 2.1 time: 0.414748 Feb 12 04:20:58.387072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 143/291] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:20:57 2022] DELETE /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments/52f5e0a7-86da-4ed8-8a26-a10611103ca2 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 04:20:58.397302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:58.398597 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:58.406181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:58.406743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:58.407696 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:58.408196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:58.441515 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6b7d367d-aea3-4c43-8c94-d12fa545bcf6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048175 Feb 12 04:20:58.442091 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 144/292] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:58 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:20:58.589626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'create', calling method: .version_select at 0x7f8e687464c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2053435355"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:58.598488 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:20:58.602923 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for user 5c6aef15658546e7a2f0592119184000 and project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:20:58.905367 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:20:58.908910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for user 5c6aef15658546e7a2f0592119184000 and project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:20:58.922022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2ccae1c7-cf27-4ff2-8c00-1f2043b8e99f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.340636 Feb 12 04:20:58.922607 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 145/293] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 04:20:58 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:20:58.968991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-49981090", "imageRef": "ddea9dd4-f74b-4ef2-8e68-b072b7bed35b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2053435355", "networks": [{"uuid": "3698e3ff-e0ee-4136-91ba-4dc73b59fee7"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:20:59.023014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] validate_networks() for [('3698e3ff-e0ee-4136-91ba-4dc73b59fee7', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:20:59.416077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:20:59.416501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:20:59.416979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:20:59.417420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:20:59.417847 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:20:59.426518 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:59.426964 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:59.427774 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:59.428812 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:59.445097 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:20:59.449233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Getting quotas for user 5c6aef15658546e7a2f0592119184000 and project 5e5dbd3a980c4a1cb1d42b3a8b962124. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:20:59.460267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:20:59.462600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddea9dd4-f74b-4ef2-8e68-b072b7bed35b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:20:59.593532 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b12677ca-b1ec-4d65-ab8b-ff7b4ca9745c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628212 Feb 12 04:20:59.594161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 146/294] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:20:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 04:20:59.599075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:59.601905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:59.609798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:59.610225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:59.610999 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:20:59.611425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:20:59.641861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ebcf8cf3-373d-4668-97fb-e7615c48286c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046554 Feb 12 04:20:59.642424 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 147/295] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:20:59 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:20:59.647370 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cf9e2696-bbd8-4c52-9d2a-cfa42c28a804 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:20:59.647962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cf9e2696-bbd8-4c52-9d2a-cfa42c28a804 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:20:59.702975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cf9e2696-bbd8-4c52-9d2a-cfa42c28a804 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:20:59.711157 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cf9e2696-bbd8-4c52-9d2a-cfa42c28a804 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1257 microversion: 2.1 time: 0.067672 Feb 12 04:20:59.711786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 148/296] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:20:59 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:00.653136 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:00.654196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:00.661143 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:00.661625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:00.662444 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:00.662910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:00.693444 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7a30e969-b573-4f8f-abd0-5c90cf068682 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Feb 12 04:21:00.694019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 149/297] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:00 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:00.728715 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d6d4875a-9d47-4e9a-ac0d-6263e707ae90 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:00.729601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d6d4875a-9d47-4e9a-ac0d-6263e707ae90 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:00.786593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d6d4875a-9d47-4e9a-ac0d-6263e707ae90 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:00.793626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d6d4875a-9d47-4e9a-ac0d-6263e707ae90 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1257 microversion: 2.1 time: 0.069376 Feb 12 04:21:00.794389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 150/298] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:00 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:00.917446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-876fa812-4b92-4e7f-91d9-67fb2a7baf41 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.052628 Feb 12 04:21:00.919348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 149/299] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:20:57 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 194 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:01.493987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:01.494664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:01.502979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.508175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.508175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.508175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.542189 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lazy-loading 'flavor' on Instance uuid 5d27a38f-f79b-4a12-8dd1-e520acda4662 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:21:01.707715 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:01.708745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:01.724386 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.724954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.725821 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.726265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.758603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-de9921a0-6e63-407b-9224-850efc544361 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058129 Feb 12 04:21:01.759176 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 150/300] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:01 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:21:01.810939 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:01.811539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:01.817991 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.818356 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.819854 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:01.820284 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:01.911148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:01.919229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d7ab809d-8fec-43eb-944c-49d1a90cafe1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1309 microversion: 2.1 time: 0.112173 Feb 12 04:21:01.919899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 151/301] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:01 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:02.120323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-78336924", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a"}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:02.304325 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-57357b8d-9d80-40ae-b465-bd8948405016 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/action" status: 202 len: 0 microversion: 2.20 time: 0.812664 Feb 12 04:21:02.305069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 151/302] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 04:21:01 2022] POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:21:02.316859 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] validate_networks() for [('5aaa3e3d-32f8-48ca-8027-3d9acf4fc85a', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:21:02.324591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:02.325581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:02.332344 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:02.332798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:02.333672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:02.334111 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:02.583792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:02.599625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:02.601265 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:02.602481 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1761e989-9d6f-4eff-bc1d-582623d51040 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.291945 Feb 12 04:21:02.603032 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 152/303] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:02 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:02.938860 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:02.939487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:02.946068 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:02.946808 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:02.947799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:02.948391 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.090658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:03.099276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0dec2ceb-a470-4d3d-b732-dc12fc4bac6d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1317 microversion: 2.1 time: 0.163973 Feb 12 04:21:03.100402 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 153/304] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:02 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:03.103507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:21:03.104476 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:21:03.105113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:21:03.105414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "932a0f70-0de7-4f4c-8743-edcd5e47ef4a"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:03.105923 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:21:03.106559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:21:03.106713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:03.113065 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.113548 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.114333 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.114769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.119078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.119697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.120631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.124949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.166126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:21:03.171832 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Getting quotas for user e3609a9d4fe144b68a62ad4696301244 and project fece42b3279f4d4aac21d7922c52c5ed. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:21:03.190016 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:21:03.192446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:21:03.355929 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d68b4639-1966-45cc-97f3-0d34ea9bd4ef tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240040 Feb 12 04:21:03.356644 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 152/305] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:21:03.366908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c2c6a241-f754-4af7-b6ab-2dcc4fcee61c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:03.375697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c2c6a241-f754-4af7-b6ab-2dcc4fcee61c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:03.446116 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c2c6a241-f754-4af7-b6ab-2dcc4fcee61c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:03.452993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c2c6a241-f754-4af7-b6ab-2dcc4fcee61c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1216 microversion: 2.1 time: 0.089944 Feb 12 04:21:03.461758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 153/306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:03 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:03.623649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:03.623649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:03.630925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.631403 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.635798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:03.636238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:03.802141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:03.810861 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:03.812353 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:03.813559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f4b2f7f0-928d-40b3-b238-010c5f7e1c34 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.195980 Feb 12 04:21:03.814154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 154/307] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:03 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:04.120295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:04.121042 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:04.131500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.134041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:04.139189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.140768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:04.207413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5f8adba1-44dd-4096-881b-862b542152aa tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104632 Feb 12 04:21:04.208100 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 154/308] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:21:03 2022] POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:04.425701 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:04.436183 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-74e8ccf1-dbb8-4bd2-9b24-e0b2c94d8c1d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.321321 Feb 12 04:21:04.437762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 155/309] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:04 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:04.474688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:04.475909 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:04.489525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.491678 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:04.493058 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.494213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:04.574767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:04.583288 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5807efe2-03ce-42ba-b184-86b7f2898265 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1220 microversion: 2.1 time: 0.115056 Feb 12 04:21:04.597576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 155/310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:04 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:04.832942 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:04.836488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:04.845307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.857642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:04.859077 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:04.859886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.126890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:05.152120 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:05.154142 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:05.155524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-994dcacf-a868-4817-a18b-be573bae3579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.327001 Feb 12 04:21:05.167686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 156/311] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:04 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:05.468221 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:05.470093 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:05.484562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:05.485353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.488449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:05.489172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.605024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:05.606202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:05.621708 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:05.622420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.623480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:05.624037 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.767113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:05.782113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7e7d8d94-33b0-45dd-a659-c3f1782becc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1220 microversion: 2.1 time: 0.182073 Feb 12 04:21:05.783434 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 157/312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:05 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:05.809904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-f8828e61-44b6-4f29-8d32-a3d750ddc241 req-1ce6828e-a8ce-46b6-ac5d-715a1d2f7622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:05.814940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:05.814940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:05.820178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:05.833931 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6e55d92c-6094-472b-99fe-8e29ba039831 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.379613 Feb 12 04:21:05.839067 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 156/313] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:05 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:05.842774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f8828e61-44b6-4f29-8d32-a3d750ddc241 req-1ce6828e-a8ce-46b6-ac5d-715a1d2f7622 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:05.843499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f8828e61-44b6-4f29-8d32-a3d750ddc241 req-1ce6828e-a8ce-46b6-ac5d-715a1d2f7622 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:05.882013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-f8828e61-44b6-4f29-8d32-a3d750ddc241 req-1ce6828e-a8ce-46b6-ac5d-715a1d2f7622 service nova] Creating event network-changed:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:21:05.890297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-f8828e61-44b6-4f29-8d32-a3d750ddc241 req-1ce6828e-a8ce-46b6-ac5d-715a1d2f7622 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085551 Feb 12 04:21:05.891385 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 158/314] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:06.184218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:06.185209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:06.202803 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.204525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.206223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.207955 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.390309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:06.398528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:06.400037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:06.401389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d2c21337-6a3d-4cdd-b3d4-8e508b861f79 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.227992 Feb 12 04:21:06.401967 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 157/315] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:06 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:06.816530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:06.817399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:06.823744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.824156 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.824955 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.825409 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.858305 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:06.859963 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:06.868165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.868938 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.870140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:06.870739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:06.897539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:06.906674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d9e6cc92-7197-4a7e-b957-7e34c4bc9300 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.096839 Feb 12 04:21:06.915509 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 159/316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:06 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:07.034264 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:07.042572 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-720e056d-0347-4e29-a95e-08cfd77610a4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.189670 Feb 12 04:21:07.043307 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 158/317] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:06 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:07.423374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:07.424309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:07.445200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:07.445200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:07.445200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:07.445200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:07.630972 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:07.648564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:07.694797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:07.694797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ef8d753d-6d6d-429c-98ce-2c8c0fa9662d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.244639 Feb 12 04:21:07.694797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 160/318] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:07 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:07.924253 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:07.925019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:07.932592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:07.933269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:07.934298 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:07.934726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:08.028554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:08.028554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-45f76326-0ab6-4d1a-84a3-2f8143613505 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.104234 Feb 12 04:21:08.028554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 159/319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:07 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:08.062464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:08.063994 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:08.070799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:08.071253 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:08.072045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:08.072648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:08.234611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:08.243033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e334f12d-981d-4d2c-87c3-64d6eedd24ee tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.186535 Feb 12 04:21:08.244209 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 161/320] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:08 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:08.709868 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:08.711003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:08.717644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:08.718169 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:08.719121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:08.719614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:08.931022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:08.940759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:08.942827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:08.944586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3b5f715b-0e3d-48a4-b786-fa6de8d23bbc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.240303 Feb 12 04:21:08.945151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 160/321] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:08 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:09.044592 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:09.045201 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:09.051332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.051843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:09.052887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.053604 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:09.124438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:09.137066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9d506ad5-6655-48fe-a431-f2aa4f0f2842 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.092366 Feb 12 04:21:09.137066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 162/322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:09 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:09.260179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:09.260779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:09.267383 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.267824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:09.268652 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.269081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:09.420903 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:09.429139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-acf72bb2-6c2b-4330-96ee-7868fcf03e16 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.173036 Feb 12 04:21:09.429860 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 161/323] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:09 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:09.964279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:09.964897 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:09.970716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.973035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:09.973035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:09.973035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:10.131236 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:10.139862 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:10.141619 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:10.142791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-501e98f6-1f95-4665-9c9b-5093832ff846 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.182589 Feb 12 04:21:10.143339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 163/324] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:09 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:10.151074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:10.154011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:10.177967 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:10.178448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:10.179242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:10.179667 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:10.248510 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:10.255720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-173c3e10-1eb6-488a-aeb8-1e13c8c0659c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.108796 Feb 12 04:21:10.256311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 162/325] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:10 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:10.461557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:10.463761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:10.471006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:10.471479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:10.472272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:10.472713 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:10.671032 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:10.679211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-849f0fde-933c-4dec-a2ea-60e94a2d215e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.224026 Feb 12 04:21:10.679848 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 164/326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:10 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:11.167493 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:11.168841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:11.175904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.176823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.177815 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.179227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.271754 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:11.273374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:11.281025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.281872 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.283044 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.283690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.370990 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:11.386486 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-dfd4f1fd-6fa4-42b2-a94d-f12654ae767a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.118267 Feb 12 04:21:11.390138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 165/327] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:11 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:11.399321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:11.407914 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:11.409746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:11.411172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-641015c1-9bec-4ab1-9f6e-05ce7e4b775f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.248291 Feb 12 04:21:11.412045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 163/328] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:11 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:11.697036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:11.697778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:11.712337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.712900 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.713843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:11.714352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:11.872890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:11.881864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f69f5a1a-db8f-4422-a748-b8edd9a5d21f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.188527 Feb 12 04:21:11.883599 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 166/329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:11 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:12.408655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:12.409314 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:12.416954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.420499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:12.420499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.420499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:12.434782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:12.436091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:12.442530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.443035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:12.443899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.444331 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:12.485875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:12.494672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2519ee19-7e00-460d-a757-90921b9c5fab tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.093338 Feb 12 04:21:12.503920 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 164/330] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:12 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:12.632926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:12.641539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:12.643417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:12.644817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0e300151-aebb-480b-afd8-7706e967a668 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.214740 Feb 12 04:21:12.645772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 167/331] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:12 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:12.899399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:12.900047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:12.911458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.911458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:12.913870 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:12.914931 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:13.069948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:13.077930 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d49e966b-03d7-4009-9c4b-f71ac204b593 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.182478 Feb 12 04:21:13.079586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 165/332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:12 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:13.513512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:13.515306 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:13.523319 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:13.523837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:13.524833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:13.525272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:13.606275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:13.615591 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5aa1d581-0da9-4a74-9c21-c58f7256b1c6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.107726 Feb 12 04:21:13.616365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 168/333] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:13 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:13.664366 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:13.675716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:13.681650 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:13.682380 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:13.683809 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:13.684341 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:13.859058 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:13.867338 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:13.868844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:13.870060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f1f905be-2d59-4674-b053-d7f544bf29c5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.210628 Feb 12 04:21:13.870629 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 166/334] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:13 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:14.096385 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:14.097151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:14.103945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.104649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:14.105740 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.106173 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:14.252221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:14.260770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-12b8b671-b183-470d-8c1d-a4915806e4d3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.168502 Feb 12 04:21:14.264374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 169/335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:14 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:14.633192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:14.634106 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:14.640784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.641563 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:14.643139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.643736 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:14.708616 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:14.716419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0f8c7db1-f181-47b4-ba67-141e1b5591c9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.088256 Feb 12 04:21:14.716971 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 167/336] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:14 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:14.888127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:14.888775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:14.895550 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.895987 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:14.897334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:14.897769 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:15.046699 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:15.054864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:15.056392 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:15.057599 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3e5b0379-fd43-4162-9e44-ab0a317d1685 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.173254 Feb 12 04:21:15.058158 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 170/337] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:14 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:15.277727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:15.278336 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:15.285800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:15.285800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:15.285800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:15.287790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:15.426377 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:15.434441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6e428095-988f-44b7-9741-37ffd2fa3b0e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.160353 Feb 12 04:21:15.435215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 168/338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:15 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:15.733533 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:15.734250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:15.739832 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:15.740269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:15.741564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:15.741993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:15.800396 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:15.808066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-af659124-c11a-4015-b50a-cc30136d8bc9 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1212 microversion: 2.1 time: 0.078467 Feb 12 04:21:15.808611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 171/339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:15 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:16.075355 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:16.077090 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:16.085866 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.086509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.087406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.087933 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.229703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:16.237784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:16.239271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:16.240409 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cff223d1-be0a-482e-97d4-461b1aae8f07 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.168809 Feb 12 04:21:16.240960 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 169/340] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:16 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:16.451935 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:16.453236 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:16.470047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.470047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.470047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.470047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.594994 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:16.602408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d737125a-47eb-418b-886b-b763b83ae814 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.154240 Feb 12 04:21:16.603175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 172/341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:16 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:16.802262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-96788811", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "1b4c56bc-a8c6-4d19-a027-a619a25face0"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:16.828084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:16.828700 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:16.835210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.839509 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.840328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:16.840763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:16.878616 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] validate_networks() for [('1b4c56bc-a8c6-4d19-a027-a619a25face0', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:21:16.918602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:16.926038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-22f2c57a-52b8-46dd-98e1-4f3fe19d08e5 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1268 microversion: 2.1 time: 0.104346 Feb 12 04:21:16.926752 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 173/342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:16 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:17.262099 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:17.262891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:17.272204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.274330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.274330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.274330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.302793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:21:17.303884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:21:17.304197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:21:17.304603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:21:17.305002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:21:17.328434 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.329002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.329915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.330423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.348122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Getting quotas for project 2c9d14816d4e4f7c9fdd17604fe92747. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:21:17.353406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Getting quotas for user 5b5c229e1d0c4da7bc08c068d087a6bc and project 2c9d14816d4e4f7c9fdd17604fe92747. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:21:17.367906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:21:17.370606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:21:17.453927 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:17.463680 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:17.465195 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:17.466666 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-571e450b-f8f0-4a65-a397-7bee2b2643ca tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.209115 Feb 12 04:21:17.467290 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 174/343] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:17 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:17.600497 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-521e69ed-12e2-4f8e-abb0-f096dc85a026 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802652 Feb 12 04:21:17.601198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 170/344] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:21:17.611785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2d87fa09-a9e0-4152-9afe-38d8c71ae76f tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:17.612694 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2d87fa09-a9e0-4152-9afe-38d8c71ae76f tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:17.644461 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:17.645182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:17.653335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.655997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.656838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.657322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.711610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2d87fa09-a9e0-4152-9afe-38d8c71ae76f tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:17.721579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2d87fa09-a9e0-4152-9afe-38d8c71ae76f tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1217 microversion: 2.1 time: 0.113813 Feb 12 04:21:17.727191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 175/345] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:17 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:17.845490 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:17.853788 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4cae66ad-c2cd-40a7-94bd-49c0985e2827 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.237100 Feb 12 04:21:17.854537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 171/346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:17 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:17.943408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:17.944149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:17.950271 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.950722 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:17.951493 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:17.952025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.123893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:18.138195 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ed9007fc-316d-4cf2-9185-b453cf119a48 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.197859 Feb 12 04:21:18.139676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 176/347] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:17 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:18.486733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:18.487347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:18.493720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.494171 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.494948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.495382 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.627746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:18.635606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:18.637108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:18.638276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-32ee0de5-ca98-4491-afac-19e542d87eb6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.157236 Feb 12 04:21:18.638840 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 172/348] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:18 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:18.745005 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7b827f16-48a5-480b-96a6-8cb1481dde48 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:18.745646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7b827f16-48a5-480b-96a6-8cb1481dde48 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:18.833717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7b827f16-48a5-480b-96a6-8cb1481dde48 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:18.844214 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7b827f16-48a5-480b-96a6-8cb1481dde48 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1217 microversion: 2.1 time: 0.104131 Feb 12 04:21:18.849541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 177/349] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:18 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:18.870278 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:18.870888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:18.878094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.878094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.878352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.878737 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.974357 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:18.975961 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:18.983172 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.983756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:18.984624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:18.985134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.026252 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'flavor' on Instance uuid 5d27b809-ac65-4266-99af-19350a4a9c03 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:21:19.059233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.069848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8e594494-2fb6-467c-8ea9-37da61e96b3e tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.202995 Feb 12 04:21:19.072201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 173/350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:18 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:19.108068 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-fb21d8ac-ab07-4517-aec2-f4f8404aa01c req-128d43a0-e112-4cba-beef-4207dec7a7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33357a53-b2b2-4778-aeb1-ffe3f89c3699", "tag": "c2ad8f86-26e5-4b78-89c3-4c6cf71428c8"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:19.113142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:19.113142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:21:19.123839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-fb21d8ac-ab07-4517-aec2-f4f8404aa01c req-128d43a0-e112-4cba-beef-4207dec7a7e0 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.124276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-fb21d8ac-ab07-4517-aec2-f4f8404aa01c req-128d43a0-e112-4cba-beef-4207dec7a7e0 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.138103 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-fb21d8ac-ab07-4517-aec2-f4f8404aa01c req-128d43a0-e112-4cba-beef-4207dec7a7e0 service nova] Creating event network-changed:c2ad8f86-26e5-4b78-89c3-4c6cf71428c8 for instance 33357a53-b2b2-4778-aeb1-ffe3f89c3699 on hv-cinder-82869 Feb 12 04:21:19.144184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-fb21d8ac-ab07-4517-aec2-f4f8404aa01c req-128d43a0-e112-4cba-beef-4207dec7a7e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 Feb 12 04:21:19.144716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 174/351] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:19.167784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:19.168641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:19.175094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.175541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.176318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.176744 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.360491 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.370141 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e3b8cba7-90e1-44d5-8166-9d25fccae888 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.216973 Feb 12 04:21:19.372824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 175/352] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:19 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:19.656830 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:19.657466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:19.665803 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.667309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.667309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.667611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.821560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.830079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a3e3399c-1215-4390-8d78-8e1505c633ba tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action" status: 200 len: 32 microversion: 2.1 time: 0.859467 Feb 12 04:21:19.830774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 178/353] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:21:18 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action => generated 32 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:21:19.845059 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:19.845790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:19.850158 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.853328 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.856217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-89496517-1658-4980-8140-d00692ad750c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.201632 Feb 12 04:21:19.856441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.856441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.856621 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 176/354] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:19 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:19.856699 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.856905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.862257 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:19.863393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:19.871828 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.872593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.873569 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:19.874207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:19.953364 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:19.963730 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-eb409cd4-0549-45ad-af86-c033392f6ccc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1221 microversion: 2.1 time: 0.104448 Feb 12 04:21:19.964316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 177/355] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:19 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:20.033593 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:20.042470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1a27889a-1df2-4452-9b17-a36f3fc8edfa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.203663 Feb 12 04:21:20.043141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 179/356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:19 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:20.086418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:20.086942 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:20.093029 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.093602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.099321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.104654 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.249299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:20.257436 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4ed770b1-b7e9-4b7c-bc55-af081635493c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.175236 Feb 12 04:21:20.266920 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 178/357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:20 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:20.390575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:20.391527 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:20.398689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.400032 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.401065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.401585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.540100 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:20.547241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ffa0da2c-5b3e-422f-95a8-3be24502a041 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.160604 Feb 12 04:21:20.547802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 180/358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:20 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:20.872419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:20.873143 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:20.879352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.879800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.880566 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.881581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.895188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-ce7c5a66-1ee7-4f79-b658-dc214120c825 req-dd2f185b-e488-44e2-ac88-aa5cbd2dced2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "name": "network-vif-plugged", "status": "completed", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:20.899259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:20.899259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:20.906057 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ce7c5a66-1ee7-4f79-b658-dc214120c825 req-dd2f185b-e488-44e2-ac88-aa5cbd2dced2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.906493 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ce7c5a66-1ee7-4f79-b658-dc214120c825 req-dd2f185b-e488-44e2-ac88-aa5cbd2dced2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.917542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-ce7c5a66-1ee7-4f79-b658-dc214120c825 req-dd2f185b-e488-44e2-ac88-aa5cbd2dced2 service nova] Creating event network-vif-plugged:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:21:20.924160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-ce7c5a66-1ee7-4f79-b658-dc214120c825 req-dd2f185b-e488-44e2-ac88-aa5cbd2dced2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032112 Feb 12 04:21:20.924160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 181/359] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:20.983465 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:20.984728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:20.991755 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.992487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:20.993530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:20.994216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.034267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.046945 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.048447 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.049836 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-455e90b7-6ce4-43c4-bc7b-7ee61d8005f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.180995 Feb 12 04:21:21.061302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 179/360] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:20 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:21.069461 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:21.070413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:21.073568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.078505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.079135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.082480 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.082480 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.083348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-889b9ecf-1934-488c-b24c-fe9f53ee7955 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1277 microversion: 2.1 time: 0.104543 Feb 12 04:21:21.084035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 182/361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:20 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:21.249398 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.257301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-68c322f0-6490-42b7-8ba7-0623ad8455f8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.192088 Feb 12 04:21:21.257882 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 180/362] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:21 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:21.274372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:21.276716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:21.281946 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.282400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.283222 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.283692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.497040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.509091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9eaead9c-6b56-469e-8f4a-58889c53b0b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.238201 Feb 12 04:21:21.510007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 183/363] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:21 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:21.562720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:21.563328 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:21.569731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.570197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.570966 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:21.571400 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:21.718272 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:21.724895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-51ba3468-57cb-418a-8e8f-5f0de93c5666 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.165646 Feb 12 04:21:21.725548 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 181/364] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:21 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:22.073820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:22.074449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:22.081070 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.085090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.085090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.085090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.099636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:22.100251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:22.106868 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.107320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.108098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.108727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.400428 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.409468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.411241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.412507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c5c4f1ed-388c-4fa5-821f-3fca52f23134 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1745 microversion: 2.20 time: 0.346347 Feb 12 04:21:22.413089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 184/365] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:22 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1745 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:22.414818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.422037 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:22.425007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:22.426335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-286a57f1-5323-4c78-9719-bda59d8f2df4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.330287 Feb 12 04:21:22.427156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 182/366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:22 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:22.430739 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.431189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.431993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.432488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.529145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:22.529881 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:22.540068 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.545448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.545448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.545448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.655656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.664731 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-bcf53d03-8832-4f94-84d2-e1eb79e783cf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.250540 Feb 12 04:21:22.665542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 185/367] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:22 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:22.751210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:22.763579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:22.764029 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.765506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3dfbf64a-d87c-45bd-8897-cc7691541f14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1357 microversion: 2.1 time: 0.240795 Feb 12 04:21:22.774615 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 183/368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:22 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:22.774962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.774962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.777264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:22.777747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:22.972007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:22.981451 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b76a4d22-436c-4f6c-92ce-17415b123172 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.239055 Feb 12 04:21:22.983669 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 186/369] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:22 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:23.203993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-a658621c-004c-45b1-b380-e8bd9b96523e req-b0d4787f-554c-477c-89b7-31819d2639d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4962f036-56e6-4737-8652-dad9f205453e", "tag": "aeb35bd6-6f27-4770-be83-8e67439cf22d"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:23.206087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:23.206087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:21:23.224558 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-a658621c-004c-45b1-b380-e8bd9b96523e req-b0d4787f-554c-477c-89b7-31819d2639d6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.225234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-a658621c-004c-45b1-b380-e8bd9b96523e req-b0d4787f-554c-477c-89b7-31819d2639d6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.237508 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-a658621c-004c-45b1-b380-e8bd9b96523e req-b0d4787f-554c-477c-89b7-31819d2639d6 service nova] Creating event network-changed:aeb35bd6-6f27-4770-be83-8e67439cf22d for instance 4962f036-56e6-4737-8652-dad9f205453e on hv-cinder-82869 Feb 12 04:21:23.243374 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-a658621c-004c-45b1-b380-e8bd9b96523e req-b0d4787f-554c-477c-89b7-31819d2639d6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043730 Feb 12 04:21:23.243948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 184/370] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:23.432753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:23.433460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:23.445177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:23.445918 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:23.455078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.457668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.458437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.458603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.458888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.459718 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.460152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.460259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.693913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:23.698020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:23.702883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:23.705537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1b02e124-5314-46d3-a8f8-57508c662d86 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.265146 Feb 12 04:21:23.714975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:23.717150 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 185/371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:23 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:23.722777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:23.723124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0af3cfb1-84b6-48e5-91f1-7c9d67ba0725 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1745 microversion: 2.20 time: 0.293751 Feb 12 04:21:23.723791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:23.727411 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 187/372] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:23 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:23.742416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.742903 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.744979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.745784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.784164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:23.784868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:23.793038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.793736 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.794711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:23.795196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:23.938379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:23.947186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4f6cc41c-65d8-47fe-afff-7e6ab52f90a7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.228841 Feb 12 04:21:23.949089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 186/373] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:23 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:24.004191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.013717 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.014342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:24.025118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d77ae459-4c9d-452f-9d76-8787b063cd5d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1547 microversion: 2.1 time: 0.245799 Feb 12 04:21:24.039474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.039925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.040731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.041785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 188/374] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:23 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1547 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:24.046811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.051649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.052568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:24.068709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.069454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.070395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.071031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.266897 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.270248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.274886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0003c456-5019-4b5c-8884-3596db8ec34f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.267627 Feb 12 04:21:24.275920 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 187/375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:24.278079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9d0cf23a-9aad-409c-ac8a-6a0b09e4dac3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1547 microversion: 2.1 time: 0.235194 Feb 12 04:21:24.278642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 189/376] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1547 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:24.294217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.297889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:24.297889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:21:24.299041 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.299664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Searching by: {'deleted': False, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124'} {{(pid=116750) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 04:21:24.306818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.307256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.308048 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.308474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.397813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.multi_cell_list [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116750) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 04:21:24.497019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b7a150e0-0e53-4687-a9cd-c73bd2e58982 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.206676 Feb 12 04:21:24.497613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 188/377] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers => generated 341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:24.507507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.508232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:24.514478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.514928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.515689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.516113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.703426 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.711171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ad18a821-14d5-4e28-83ad-50a6e42f7794 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1547 microversion: 2.1 time: 0.207330 Feb 12 04:21:24.711735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 190/378] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:24.723392 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.724247 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:24.731761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.732403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.733371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.734121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.751431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:24.752348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:24.762329 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.762990 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.765970 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:24.766542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:24.978389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:24.987125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-46cbfdd0-283a-4ed8-9747-b319d5d26028 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.267951 Feb 12 04:21:24.993822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 189/379] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:24.994375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:25.004482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-382547c0-99c0-40c9-8e76-ac56fd097617 req-bf9a692a-7cd9-45f1-bea1-1614776b83ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "name": "network-vif-plugged", "status": "completed", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:25.007328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:25.009492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:25.009492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:21:25.009729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:25.011865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2883d5fb-3fe8-44d4-881a-009022f8821c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1745 microversion: 2.20 time: 0.266735 Feb 12 04:21:25.012660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 191/380] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:24 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1745 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:25.021586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-382547c0-99c0-40c9-8e76-ac56fd097617 req-bf9a692a-7cd9-45f1-bea1-1614776b83ab service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:25.021586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-382547c0-99c0-40c9-8e76-ac56fd097617 req-bf9a692a-7cd9-45f1-bea1-1614776b83ab service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:25.030997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-382547c0-99c0-40c9-8e76-ac56fd097617 req-bf9a692a-7cd9-45f1-bea1-1614776b83ab service nova] Creating event network-vif-plugged:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:21:25.032220 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:25.033798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:25.038111 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-382547c0-99c0-40c9-8e76-ac56fd097617 req-bf9a692a-7cd9-45f1-bea1-1614776b83ab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044626 Feb 12 04:21:25.038875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 190/381] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:25.042319 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:25.042819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:25.044381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:25.044830 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:25.193622 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:25.202119 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1cda521d-6ed0-4473-8b68-8a152a63296d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.175065 Feb 12 04:21:25.202660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 192/382] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:25 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:25.292736 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:25.293450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:25.299925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:25.300485 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:25.301493 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:25.302067 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:25.444533 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:25.453905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8a571420-923f-43b5-b381-17288f91e7f2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.165447 Feb 12 04:21:25.455332 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 191/383] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:25 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:26.008367 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:26.009767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:26.016705 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.017151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.018179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.018800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.035044 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:26.036039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:26.059739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.060644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.061624 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.062212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.563539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.573916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-75516ce3-b043-4b47-bde2-d9242f5be149 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.569460 Feb 12 04:21:26.580943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 193/384] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:26 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:26.580943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:26.580943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:26.590689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.591312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.592684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.593317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.608831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.623604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.626729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.626729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1bf94154-bcc8-4c15-8b7e-64c8687c8f35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.596990 Feb 12 04:21:26.626976 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 192/385] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:26 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:26.634253 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:26.634858 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:26.655376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.655826 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.656690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.657125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.912881 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.924270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c9aff1e8-ed31-471a-acd3-b4c6aa81ca3b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.293317 Feb 12 04:21:26.952376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 193/386] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:26 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:26.952376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c231134-7583-4349-8116-c50bcd2b3a45"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:26.952826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:26.953024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:26.953024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.953024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.953291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4e63f3fa-17f2-44e4-a3e9-56b59753b963 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.370380 Feb 12 04:21:26.953375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:26.953375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:26.957625 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 194/387] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:26 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:27.062061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-bcb1be9f-6cd3-4a7f-8a4d-1964f5b0707a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:27.071561 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcb1be9f-6cd3-4a7f-8a4d-1964f5b0707a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:27.072317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bcb1be9f-6cd3-4a7f-8a4d-1964f5b0707a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:27.301220 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-bcb1be9f-6cd3-4a7f-8a4d-1964f5b0707a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Going to try to stop instance {{(pid=116751) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 04:21:28.672734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-bcb1be9f-6cd3-4a7f-8a4d-1964f5b0707a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action" status: 202 len: 0 microversion: 2.1 time: 1.612902 Feb 12 04:21:28.678152 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 195/388] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:21:27 2022] POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:21:28.703891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-f4594360-9d8e-435e-b9f8-c6b95bdb0f61 req-0d4b86e2-d85f-4680-b8a3-926c5d50a5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33357a53-b2b2-4778-aeb1-ffe3f89c3699", "name": "network-vif-plugged", "status": "completed", "tag": "c2ad8f86-26e5-4b78-89c3-4c6cf71428c8"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:28.705564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:28.705564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:28.715245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f4594360-9d8e-435e-b9f8-c6b95bdb0f61 req-0d4b86e2-d85f-4680-b8a3-926c5d50a5be service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:28.716275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f4594360-9d8e-435e-b9f8-c6b95bdb0f61 req-0d4b86e2-d85f-4680-b8a3-926c5d50a5be service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:28.731170 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-f4594360-9d8e-435e-b9f8-c6b95bdb0f61 req-0d4b86e2-d85f-4680-b8a3-926c5d50a5be service nova] Creating event network-vif-plugged:c2ad8f86-26e5-4b78-89c3-4c6cf71428c8 for instance 33357a53-b2b2-4778-aeb1-ffe3f89c3699 on hv-cinder-82869 Feb 12 04:21:28.736943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-f4594360-9d8e-435e-b9f8-c6b95bdb0f61 req-0d4b86e2-d85f-4680-b8a3-926c5d50a5be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057326 Feb 12 04:21:28.738257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 196/389] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:28.743631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:28.744334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:28.753459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:28.754290 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:28.756349 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:28.757250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:28.955080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:28.967448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2d582913-9749-46a8-b1a1-ab9374e9ea87 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.227701 Feb 12 04:21:28.968202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 197/390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:28 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:28.973029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:28.973932 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:28.982475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:28.984151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:28.985603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:28.986346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.155624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.164358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.166038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.167287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d76d0d8f-841f-47f5-b5ca-21a6d6e2525a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.197917 Feb 12 04:21:29.167980 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 198/391] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:28 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:29.172472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:29.173073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:29.179334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.179780 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.180549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.180978 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.343041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.375584 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7e714c8d-d0b7-4a83-acc7-4eef3e0b5f01 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.206421 Feb 12 04:21:29.376189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 199/392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:29 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:29.380429 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:29.381040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:29.387221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.388184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.388962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.389417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.534440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.543013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f78a91da-72d6-473d-940f-dee056143aab tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.165872 Feb 12 04:21:29.543581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 200/393] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:29 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:29.547714 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:29.548315 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:29.554491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.554941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.555718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:29.556158 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:29.690893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:29.699221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1ac49928-dde3-4472-b6bf-2ac43d587c24 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.154637 Feb 12 04:21:29.700033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 201/394] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:29 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:29.980331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cfca8fb0-c1e2-4e3d-aa44-7b6cb989e089 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.050665 Feb 12 04:21:29.981749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 194/395] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:21:26 2022] POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments => generated 194 bytes in 3054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:29.986618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:29.986618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:30.006579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.012027 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.013841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.017191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.186228 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:30.197309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:30.197309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.197309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.197309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.198639 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.241437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.248888 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7d317842-d2d1-4a2b-bc04-63dd4ccbbcbf tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.268407 Feb 12 04:21:30.249521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 202/396] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:29 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:30.392017 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:30.392798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:30.401979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.406849 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.407629 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.408316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.410258 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.425321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.427172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.437134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5523b8c2-7331-4899-bde4-48865d8e403c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.246505 Feb 12 04:21:30.437134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 195/397] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:30 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:30.561927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:30.564009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:30.576911 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.596357 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.596867 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.598595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d77fc7c6-8a37-4566-b5ee-5ac3a7c47a9b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1316 microversion: 2.1 time: 0.210245 Feb 12 04:21:30.601731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.602395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 203/398] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:30 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:30.603076 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.717817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:30.718590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:30.730152 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.730801 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.732288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:30.733963 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:30.906245 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.915376 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c8f80e4e-91d5-4323-8c3b-62f17dcbeeec tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.357091 Feb 12 04:21:30.927080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 196/399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:30 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:30.956009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:30.956009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1a295ea3-fd53-4dd4-a7e8-492227efa26f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.241408 Feb 12 04:21:30.965986 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 204/400] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:30 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:31.269497 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:31.272613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-8ffcb904-020e-43d4-a24f-749d2bf5cdfb req-2b64af42-cf0d-490c-9557-d03d9c59c42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4962f036-56e6-4737-8652-dad9f205453e", "name": "network-vif-plugged", "status": "completed", "tag": "aeb35bd6-6f27-4770-be83-8e67439cf22d"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:31.273793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:31.274732 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:31.274732 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:31.297765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.298644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.299676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.300276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.306842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-8ffcb904-020e-43d4-a24f-749d2bf5cdfb req-2b64af42-cf0d-490c-9557-d03d9c59c42f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.312651 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-8ffcb904-020e-43d4-a24f-749d2bf5cdfb req-2b64af42-cf0d-490c-9557-d03d9c59c42f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.331866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-8ffcb904-020e-43d4-a24f-749d2bf5cdfb req-2b64af42-cf0d-490c-9557-d03d9c59c42f service nova] Creating event network-vif-plugged:aeb35bd6-6f27-4770-be83-8e67439cf22d for instance 4962f036-56e6-4737-8652-dad9f205453e on hv-cinder-82869 Feb 12 04:21:31.337495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-8ffcb904-020e-43d4-a24f-749d2bf5cdfb req-2b64af42-cf0d-490c-9557-d03d9c59c42f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068557 Feb 12 04:21:31.342406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 205/401] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:31.449068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:31.452458 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:31.462273 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.463572 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.477767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.478262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.614839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:31.623704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f39bcd47-aa1b-49ca-803c-3cbf412bd6e3 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.359778 Feb 12 04:21:31.624287 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 197/402] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:31 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:31.639165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:31.640028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:31.647195 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.647668 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.648437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.648863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.710941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:31.719474 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:31.721996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:31.723249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9d4e79da-a0fd-4a38-bf44-00330dc8fbe1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.280245 Feb 12 04:21:31.723825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 206/403] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:31 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:31.841931 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:31.850434 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b23a8be4-6f21-4259-8f44-6ba1398e6b59 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1507 microversion: 2.1 time: 0.215539 Feb 12 04:21:31.851002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 198/404] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:31 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:31.932219 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:31.932874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:31.938961 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.939628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.940887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.941507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.977124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:31.978187 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:31.994583 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.995531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:31.996534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:31.997460 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:32.149386 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:32.163093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-333f61b6-12fa-4350-a345-5f9e3a1ab2cc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.233663 Feb 12 04:21:32.165945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 207/405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:31 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:32.212395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:32.228627 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4123f076-8b0d-47a5-9724-a45a9bd750da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.256993 Feb 12 04:21:32.242695 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 199/406] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:31 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:32.640605 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:32.641791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:32.649702 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:32.650460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:32.651478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:32.652417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:32.745502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:32.746123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:32.761009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:32.762505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:32.767473 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:32.768215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:32.931479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:32.941492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b42b4eb1-e0e2-482c-9bf5-57df2baedbec tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1317 microversion: 2.1 time: 0.304794 Feb 12 04:21:32.942189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 208/407] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:32 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:33.052879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:33.052879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:33.053175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:33.053175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a6848a8f-43d5-4d89-ac43-5e3bc8291b6f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.277027 Feb 12 04:21:33.053175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 200/408] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:32 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:33.182393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:33.183172 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:33.189328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.227311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:33.227311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.227311 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:33.246121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:33.246737 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:33.253082 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.253555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:33.254346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.254785 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:33.378125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:33.387831 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-09b5f4ac-f73f-481d-be5f-309f8f2d96bc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.209488 Feb 12 04:21:33.388491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 209/409] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:33 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:33.454522 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:33.462179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e04c1405-ae12-4efd-895d-8fb886d6d585 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.219865 Feb 12 04:21:33.462740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 201/410] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:33 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:33.961910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:33.962593 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:33.977882 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.978800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:33.979922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:33.980365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.071487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:34.072100 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:34.087874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.088312 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.089095 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.089546 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.148672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.156519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b9dbc3c3-216b-467d-b40b-08ee94327dfb tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1506 microversion: 2.1 time: 0.199244 Feb 12 04:21:34.157089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 210/411] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:33 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:34.289661 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.305782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.307273 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.308420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-985358e5-1fec-4cb8-a03a-f95a6b285c9d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.241644 Feb 12 04:21:34.308961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 202/412] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:34 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:34.405356 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:34.416812 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:34.417159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.418179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.419673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.420969 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.485761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:34.485761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:34.501916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.502371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.503560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.504247 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.626215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.639889 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0bb6eca0-cd33-481f-a41d-556f14e4bbb9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1567 microversion: 2.1 time: 0.237358 Feb 12 04:21:34.642186 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 211/413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:34 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:34.661866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9ae3406-5c78-45fe-80e1-2b247f3f3a48"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:34.669406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:34.679877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.680337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.683278 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:34.683733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:34.778342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:34.788060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d3c3365f-6c56-47ac-b293-ad721ae7d7e0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.311900 Feb 12 04:21:34.791336 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 203/414] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:34 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:35.327245 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:35.327922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:35.338602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.339192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.340012 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.340638 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.554198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:35.565523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:35.567101 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:35.569132 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c88b1579-100d-47bf-9058-702144511beb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.245702 Feb 12 04:21:35.570141 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 204/415] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:35 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:35.611381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0ecf06a6-db42-4cf6-8d20-502677785523 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "POST /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.955630 Feb 12 04:21:35.612439 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 212/416] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:21:34 2022] POST /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:35.660863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:35.664435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:35.675695 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.676899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.678277 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.678717 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.809095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:35.809958 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:35.821879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.827857 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.830021 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.830703 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.877186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:35.887962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-373ddcfd-58ae-4fb0-9f09-ca37e7b230d3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1547 microversion: 2.1 time: 0.233067 Feb 12 04:21:35.889095 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 205/417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:35 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1547 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:35.913593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:35.914577 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:35.921737 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.922899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:35.924681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:35.925350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.105450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] HTTP exception thrown: Cannot 'detach_volume' instance 5d27b809-ac65-4266-99af-19350a4a9c03 while it is in vm_state rescued Feb 12 04:21:36.106194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Returning 409 to user: Cannot 'detach_volume' instance 5d27b809-ac65-4266-99af-19350a4a9c03 while it is in vm_state rescued {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:21:36.107502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b541513c-130d-4b72-be22-07f5110d884c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments/0bb7741f-4b4d-4cfb-97b4-cc6794fbbb9c" status: 409 len: 152 microversion: 2.1 time: 0.199872 Feb 12 04:21:36.109135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 206/418] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:21:35 2022] DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments/0bb7741f-4b4d-4cfb-97b4-cc6794fbbb9c => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 12 04:21:36.118994 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:36.123450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:36.130234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.131589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.133109 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:36.135106 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.136541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.145323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-13b6ec8b-653d-41e9-860d-20811ed62008 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.338780 Feb 12 04:21:36.157810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 213/419] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:35 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:36.370743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-92b6d4cb-0378-4214-845e-02329186b5c0 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action" status: 202 len: 0 microversion: 2.1 time: 0.256520 Feb 12 04:21:36.372416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 207/420] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:21:36 2022] POST /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:21:36.392492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:36.393474 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:36.402351 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.403193 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.404596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.405363 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.598755 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:36.600703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:36.617936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.618400 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.619302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:36.619739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:36.773253 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:36.797094 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e03c632a-727f-4c88-b849-4471b193af7a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1555 microversion: 2.1 time: 0.419530 Feb 12 04:21:36.798315 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 214/421] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:36 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1555 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:36.847186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:36.855706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:36.859209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:36.859209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1c288c17-a19b-4998-853a-fed72482fbd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.273178 Feb 12 04:21:36.859209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 208/422] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:36 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:37.170137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:37.170137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:37.172171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.172171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:37.172171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.172793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:37.339444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:37.347346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7b4eaf70-d6fc-47bb-bed5-e42a04f1f03f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.187943 Feb 12 04:21:37.347931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 215/423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:37 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:37.818701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:37.818701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:37.822832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.823276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:37.824088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.824521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:37.887038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:37.887767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:37.894983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.895602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:37.897387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:37.897834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:38.041116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:38.049244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-347f9715-465e-40d0-accd-ea0e48af0019 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1555 microversion: 2.1 time: 0.237331 Feb 12 04:21:38.050177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 209/424] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:37 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:38.120587 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:38.132788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:38.134391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:38.144748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fdbe511a-1e21-4d93-a142-bfe4742fdfab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.253381 Feb 12 04:21:38.144748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 216/425] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:37 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:38.367961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:38.368902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:38.383079 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:38.383467 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:38.384282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:38.384723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:38.553416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:38.562317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0b1995bb-7f9f-4cbd-a313-73b1c7f346eb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.198692 Feb 12 04:21:38.563156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 210/426] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:38 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:39.068000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:39.068945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:39.075048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.075492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.076375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.077011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.138266 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:39.138866 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:39.145118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.145594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.146418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.147450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.258364 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.266309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-932ab62b-8773-41e5-86d3-d67f9e3b9a53 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1555 microversion: 2.1 time: 0.202351 Feb 12 04:21:39.267056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 217/427] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:39 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:39.271305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:39.272590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:39.288657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.289143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.289953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.290387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.324126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.333122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3a35cbf1-e0f1-43f8-b5e7-92e8699583d4 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1593 microversion: 2.1 time: 0.198565 Feb 12 04:21:39.333722 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 211/428] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:39 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1593 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:39.438202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.446556 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.448159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.449321 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fc2c2b9a-71a4-4d5c-862f-5ea47b568e74 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1740 microversion: 2.20 time: 0.181502 Feb 12 04:21:39.449876 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 218/429] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:39 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:39.579335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:39.580002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:39.585776 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.587011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.587011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:39.587379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:39.718092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:39.725821 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5b5518c7-824f-47af-a5c1-4fc3693361e2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.150140 Feb 12 04:21:39.726379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 212/430] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:39 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:40.286217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:40.288246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:40.297657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.298578 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.299586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.300207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.455821 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:40.469158 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:40.470351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:40.480504 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-24e72ad0-6eda-44d4-b0e7-515ddf85e7b7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1555 microversion: 2.1 time: 0.198518 Feb 12 04:21:40.481249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 219/431] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:40 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:40.491387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.492016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.492806 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.493246 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.655218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:40.665123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:40.666681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:40.667837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9206f326-298b-48b1-8bb3-8dd6f1161734 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1722 microversion: 2.20 time: 0.203450 Feb 12 04:21:40.668389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 213/432] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:40 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:40.743374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:40.744345 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:40.757118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.757690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.758725 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:40.759157 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:40.896764 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:40.906489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ec54daf4-8c40-423d-9e80-3d925a9aba87 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.166465 Feb 12 04:21:40.917084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 220/433] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:40 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:41.497710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:41.498316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:41.505331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.506386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.507212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.507641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.650448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:41.659126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9916dc29-b06e-483d-88fe-851dfdb545aa tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1561 microversion: 2.1 time: 0.164948 Feb 12 04:21:41.660086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 214/434] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:41 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:41.687770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:41.688593 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:41.695635 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.696159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.697010 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.697590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.731475 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:41.734512 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:41.738574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.739018 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.739787 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.740931 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.836213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'services' on Instance uuid 5d27b809-ac65-4266-99af-19350a4a9c03 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:21:41.851819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:41.860939 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:41.862548 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:41.863821 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-becd0dcd-37b6-4182-b951-84172be7c0d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1722 microversion: 2.20 time: 0.179864 Feb 12 04:21:41.864487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 221/435] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:41 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:41.922882 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:41.923481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:41.929800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.930244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:41.931016 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:41.931442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:42.085088 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:42.103518 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a71359f6-2321-40f4-975e-b2a1e118ada6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.183553 Feb 12 04:21:42.104443 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 222/436] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:41 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:42.118909 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-50f0d087-7029-4c2a-a471-59a0b9abd297 req-0b732e1c-c0c4-4c0a-9dfc-fbac1103e6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:42.126078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:42.126078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:42.135623 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-571309ec-ce07-4d30-ad63-7ac24af02789 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments/0bb7741f-4b4d-4cfb-97b4-cc6794fbbb9c" status: 202 len: 0 microversion: 2.1 time: 0.408014 Feb 12 04:21:42.136637 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 215/437] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:21:41 2022] DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments/0bb7741f-4b4d-4cfb-97b4-cc6794fbbb9c => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:21:42.145555 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-50f0d087-7029-4c2a-a471-59a0b9abd297 req-0b732e1c-c0c4-4c0a-9dfc-fbac1103e6e8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:42.146006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-50f0d087-7029-4c2a-a471-59a0b9abd297 req-0b732e1c-c0c4-4c0a-9dfc-fbac1103e6e8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:42.150974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:42.152684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:42.166971 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-50f0d087-7029-4c2a-a471-59a0b9abd297 req-0b732e1c-c0c4-4c0a-9dfc-fbac1103e6e8 service nova] Creating event network-changed:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:21:42.172193 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:42.173398 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-50f0d087-7029-4c2a-a471-59a0b9abd297 req-0b732e1c-c0c4-4c0a-9dfc-fbac1103e6e8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066827 Feb 12 04:21:42.192056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 223/438] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:42.192939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:42.192939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:42.192939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:42.232676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-86610145-9cc8-4512-976a-329becc5c4e4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088762 Feb 12 04:21:42.237152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 216/439] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:42 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:42.883700 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:42.884388 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:42.890603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:42.891056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:42.891843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:42.892303 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:43.060082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:43.068469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:43.070090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:43.072681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-af1d8589-1b26-4b3c-b713-573c7697dadb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1722 microversion: 2.20 time: 0.192755 Feb 12 04:21:43.072681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 224/440] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:42 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:43.121847 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:43.122563 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:43.129050 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:43.129854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:43.130839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:43.131519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:43.243908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:43.245036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:43.251511 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:43.252248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:43.253248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:43.254068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:43.296663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3e656613-a831-41d6-93da-9f0ccf92cc3c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055867 Feb 12 04:21:43.297445 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 225/441] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:43 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:43.311515 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:43.319801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d0026620-e76d-48c4-adc6-a3cf5f34bc2a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.201673 Feb 12 04:21:43.320473 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 217/442] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:43 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:44.089478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:44.090115 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:44.096408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.096863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.097717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.098183 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.264580 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:44.272871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:44.274687 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:44.275955 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d503e7d8-9c8f-4e68-ba34-278bb3b34476 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1725 microversion: 2.20 time: 0.190537 Feb 12 04:21:44.276590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 226/443] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:44 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:44.293721 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7c78a00-1af6-4a49-9091-e290f6cb45f4"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:44.295294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:44.301225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.301679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.302446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.303591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.311044 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:44.312129 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:44.322302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.322302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.322302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.322578 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.355686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-905ae57c-44dd-4c68-ae02-37d0d93c2ea9 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 Feb 12 04:21:44.359858 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 227/444] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:44 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:44.360926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:44.361756 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:44.368189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.368638 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.369447 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.369885 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.509272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:44.517979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e75ce8a5-aa82-4179-888b-eb6759ce7774 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.160527 Feb 12 04:21:44.518549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 228/445] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:44 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:44.835869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-d9d25714-3ccb-47e7-a54e-7ae21d580341 req-75c8b181-49de-4e8e-9477-91c56c701fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "name": "network-vif-unplugged", "status": "completed", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:44.837463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:44.837463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:21:44.844643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d9d25714-3ccb-47e7-a54e-7ae21d580341 req-75c8b181-49de-4e8e-9477-91c56c701fe0 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:44.845090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d9d25714-3ccb-47e7-a54e-7ae21d580341 req-75c8b181-49de-4e8e-9477-91c56c701fe0 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:44.856491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-d9d25714-3ccb-47e7-a54e-7ae21d580341 req-75c8b181-49de-4e8e-9477-91c56c701fe0 service nova] Creating event network-vif-unplugged:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:21:44.861299 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-d9d25714-3ccb-47e7-a54e-7ae21d580341 req-75c8b181-49de-4e8e-9477-91c56c701fe0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029613 Feb 12 04:21:44.862250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 229/446] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:45.213065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-139681348"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:45.213699 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:45.219920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.220361 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.221154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.221639 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.396390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.network.security_group_api [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Adding security group 7449ad82-0140-4eb9-ba7f-a0cbfb6256eb to port dd02aa9e-3381-43c8-b1fd-9ad35f7198ea Feb 12 04:21:45.751878 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6bf881e9-f700-4798-aae3-dde0bdc555a5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.461808 Feb 12 04:21:45.758760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 218/447] 10.222.0.31 () {62 vars in 1363 bytes} [Sat Feb 12 04:21:44 2022] POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments => generated 188 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:21:45.758760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:45.758760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:45.764478 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.764917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.765751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.766184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.795405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-005cf803-ee16-4c9b-a210-0dcd8f1fe7d8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Feb 12 04:21:45.796153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 219/448] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:45 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:45.800166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:45.800763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:45.810614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.811064 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.811844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.812275 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.932885 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4c273245-71ae-4d74-8958-3db64237bcb2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action" status: 202 len: 0 microversion: 2.1 time: 0.723951 Feb 12 04:21:45.934008 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 230/449] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:21:45 2022] POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 04:21:45.945767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:45.946605 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:45.957014 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.958373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:45.959896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:45.960767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.078663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:46.092434 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4cd2e9bf-2b8d-446b-aabe-4c0b4a535b26 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.295413 Feb 12 04:21:46.093142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 220/450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:45 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:46.104098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:46.104098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:46.104769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.105520 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.106311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.106749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.297849 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:46.310965 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9973fa42-bc3e-44e7-9842-b3fa3e06cac2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1758 microversion: 2.1 time: 0.216690 Feb 12 04:21:46.326492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 221/451] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:46 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:46.326492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-0aa05bcc-e4a1-4a77-a698-486190b29fe3 req-27b99adc-f1be-40dc-93ed-c16dbb7f6854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:46.326492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:21:46.326492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:21:46.329422 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-64db07a3-abdf-4cd6-9aef-2d5ed73f06f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/action" status: 202 len: 0 microversion: 2.20 time: 0.390690 Feb 12 04:21:46.334597 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 231/452] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 04:21:45 2022] POST /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:21:46.339766 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0aa05bcc-e4a1-4a77-a698-486190b29fe3 req-27b99adc-f1be-40dc-93ed-c16dbb7f6854 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.344064 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0aa05bcc-e4a1-4a77-a698-486190b29fe3 req-27b99adc-f1be-40dc-93ed-c16dbb7f6854 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.351124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:46.351744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:46.360526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.360635 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.361487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.361922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.366094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-0aa05bcc-e4a1-4a77-a698-486190b29fe3 req-27b99adc-f1be-40dc-93ed-c16dbb7f6854 service nova] Creating event network-changed:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:21:46.381819 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-0aa05bcc-e4a1-4a77-a698-486190b29fe3 req-27b99adc-f1be-40dc-93ed-c16dbb7f6854 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068928 Feb 12 04:21:46.384600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 222/453] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:46.620983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:46.634147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:46.636506 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:46.637926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b38b0e8e-e669-435c-b587-d5b8ec7d90a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1751 microversion: 2.20 time: 0.300501 Feb 12 04:21:46.650101 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 232/454] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:46 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1751 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:46.702015 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:46.702641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:46.721137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.722254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.723228 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.723820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.807683 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:46.808699 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:46.820533 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.821749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.824999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:46.825539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:46.860917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'services' on Instance uuid 33357a53-b2b2-4778-aeb1-ffe3f89c3699 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:21:46.881169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b3cebcdd-a794-4cbd-871d-3f9c16cdde39 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077693 Feb 12 04:21:46.882266 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 233/455] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:46 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:21:47.109966 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:47.110615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:47.116497 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.116949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.117751 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.118186 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.158749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f3ad1fbb-c3f8-49fb-a073-dbc0326459e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments/c9ae3406-5c78-45fe-80e1-2b247f3f3a48" status: 202 len: 0 microversion: 2.1 time: 0.464463 Feb 12 04:21:47.159885 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 223/456] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:21:46 2022] DELETE /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments/c9ae3406-5c78-45fe-80e1-2b247f3f3a48 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:21:47.169780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:47.172091 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:47.191259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.193007 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.193886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.194321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.225635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cc301c3c-a7de-456b-8b4f-7fd3aaa54d2b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060465 Feb 12 04:21:47.226831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 224/457] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:47 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:47.291198 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:47.300535 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-aa9b82c7-1b71-4324-910b-968f678c011a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.194074 Feb 12 04:21:47.301173 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 234/458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:47 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:47.655930 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:47.656539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:47.663360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.664073 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.664869 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.665508 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.810887 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:47.820586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:47.822145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:47.823297 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-61f407bb-6a24-4a20-80c1-10b83066cbb1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1751 microversion: 2.20 time: 0.171359 Feb 12 04:21:47.823900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 225/459] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:47 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:47.891836 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:47.892792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:47.898820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.899275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.900048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:47.900482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:47.932495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d199b07d-37d3-423b-b7e9-cb2e7345b143 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044257 Feb 12 04:21:47.933061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 235/460] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:47 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:21:48.238161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:48.239465 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:48.248486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.248937 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.249813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.250353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.284499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-707fd9f6-2c16-4212-8beb-edce08517ca8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050117 Feb 12 04:21:48.285167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 226/461] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:48 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:21:48.317726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:48.318340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:48.324770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.325340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.326245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.326743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.478127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:48.486881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-dea64b9c-0dfe-4bc1-bc29-3eb6a92fd73c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.172856 Feb 12 04:21:48.487644 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 236/462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:48 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:48.842343 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:48.843219 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:48.851131 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.851751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.852765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:48.854130 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:48.999734 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:49.008658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:49.010113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:49.011240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b105d8ed-657b-4200-9487-6a7e0fa1efd0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1753 microversion: 2.20 time: 0.172735 Feb 12 04:21:49.011834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 227/463] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:48 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:49.296048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:49.296960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:49.305040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:49.305523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:49.306492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:49.307428 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:49.337492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1eb430ae-0b96-4c9a-bc96-d66528ac3dbf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045243 Feb 12 04:21:49.338088 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 237/464] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:21:49 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:21:49.504731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:49.505403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:49.511677 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:49.512065 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:49.512837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:49.513268 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:49.658127 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:49.666845 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-eb1dce6d-ef8f-42eb-8889-f854d54cf73a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.165725 Feb 12 04:21:49.667451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 228/465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:49 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:50.030149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:50.030946 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:50.037210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.037690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.038525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.038954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.175154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:50.184091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:50.186889 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:50.188061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b4fff337-da78-4033-b35c-5deeb2aa8821 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1753 microversion: 2.20 time: 0.162649 Feb 12 04:21:50.188616 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 238/466] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:50 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:50.671265 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:50.671834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:50.678295 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.678751 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.680195 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.680611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.684301 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:50.685025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:50.691430 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.691879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.692665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.693099 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.706301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:21:50.832374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:50.840164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-092fdb68-025e-4c62-a518-3acbe935773b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.159469 Feb 12 04:21:50.840720 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 239/467] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:50 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:50.966367 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:50.967152 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:50.973223 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.973761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:50.974583 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:50.975021 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.001930 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:21:51.083452 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6f9f3f24-cf40-48eb-82b7-43c1ceec160a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "DELETE /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 204 len: 0 microversion: 2.1 time: 0.415595 Feb 12 04:21:51.084053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 229/468] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:21:50 2022] DELETE /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:21:51.091946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:51.092869 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:51.099484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.100044 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.101501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.101998 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.251067 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:51.258427 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-90963703-7e5c-41de-a5cf-b10ef78a788c tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.170185 Feb 12 04:21:51.259230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 230/469] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:51 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:51.263322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:51.265056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:51.269702 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.270156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.270939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.271374 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.410014 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-11e6548c-9b8e-4661-b9de-be6d0f7e78cd tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 204 len: 0 microversion: 2.1 time: 0.447236 Feb 12 04:21:51.410882 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 240/470] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:21:50 2022] DELETE /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:21:51.419894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:51.420729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:51.422050 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:51.426670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.427197 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.428065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.428568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.432393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:51.434068 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:51.435364 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c1af4c04-65f2-4436-afcd-3aa6bbdeda46 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.175377 Feb 12 04:21:51.436151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 231/471] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:51 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:51.577100 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:51.584399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e1545171-33a9-4e37-a155-1fe2fb5cba91 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.168680 Feb 12 04:21:51.585615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 241/472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:51 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:51.856912 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:51.863223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:51.863959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.864406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.865179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:51.865876 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:51.999457 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.007827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d18f63a7-bb35-47a6-aa22-68b4c3591c7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.154743 Feb 12 04:21:52.008395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 232/473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:51 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:52.275863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:52.277053 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:52.285480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.289976 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.289976 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.289976 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.438583 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.446007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8cb4aef1-3dde-477c-a4ca-6dab55fdf580 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.174272 Feb 12 04:21:52.446558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 242/474] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:52 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:52.453769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:52.455513 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:52.461947 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.462547 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.463454 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.463997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.602131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:52.603881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:52.611562 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.612407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.613646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:52.614386 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:52.651867 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.672059 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.673959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.675335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2727aef2-f251-4f91-8a94-19786ee9e2b0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.225414 Feb 12 04:21:52.681873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 233/475] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:52 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:52.816381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:52.824648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8aeb687b-c03c-4f93-9ea2-393f3dd2a1b8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.227182 Feb 12 04:21:52.825266 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 243/476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:52 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:53.031744 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:53.032261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:53.039135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.039718 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.040422 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.040894 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.177614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:53.186111 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3fc7177e-e6f4-4196-bbeb-1f5f9b310ba0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.158016 Feb 12 04:21:53.186673 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 234/477] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:53 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:53.463203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:53.463883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:53.470223 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.470677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.471793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.472465 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.625108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:53.632786 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8aaf48f6-b94a-4c4b-9320-5afc95b550dc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.173433 Feb 12 04:21:53.641045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 244/478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:53 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:53.703737 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:53.704340 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:53.710693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.711131 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.711892 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.712317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.841727 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:53.842603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:53.848936 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.849676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.850684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:53.851002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:53.851617 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:53.861003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:53.862854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:53.864037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d9d5aea1-305f-4bd0-8e75-c009de84d6a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.164220 Feb 12 04:21:53.864704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 235/479] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:53 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:54.027086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:54.037468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-63b74cee-0b74-496c-a6a0-9f39d4c74d14 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.199089 Feb 12 04:21:54.038610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 245/480] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:53 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:54.204080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:54.204780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:54.214151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.214707 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:54.215628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.216063 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:54.360781 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:54.370062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-937e76d3-078a-437e-a3e9-fc28cfb62f22 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.170207 Feb 12 04:21:54.370728 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 236/481] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:54 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:54.650697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:54.651296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:54.657850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.658297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:54.659082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.659516 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:54.810337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:54.819163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b7dd0b98-a191-4366-9d41-dc88801e0744 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.172829 Feb 12 04:21:54.820444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 246/482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:54 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:54.885020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:54.885020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:54.891257 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.891763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:54.892915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:54.893381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.038399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:55.048204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:55.050333 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:55.051395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-036ac5e1-4dc0-41ec-aa91-3043d64353e0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.172564 Feb 12 04:21:55.052457 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 237/483] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:54 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:55.056972 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:55.057988 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:55.063660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.064188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.065064 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.065591 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.202888 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:55.210719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e62d17c1-52ce-4f86-bf07-a5c8baf8b95f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.159003 Feb 12 04:21:55.211283 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 247/484] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:55 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:55.395832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:55.396443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:55.402868 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.403324 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.404109 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.404543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.550861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:55.559708 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f7d708c1-d1a5-4292-aa1e-50a019e095e7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.167650 Feb 12 04:21:55.560281 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 238/485] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:55 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:55.876030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:55.876030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:55.876030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.876030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.877171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:55.877171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:55.994088 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.005423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0cd1e7d1-3ff8-4201-bf86-be5e9afd5897 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.172940 Feb 12 04:21:56.006023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 248/486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:55 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:56.069189 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:56.069875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:56.075985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.076421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.077201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.077653 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.222180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.227656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:56.228272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:56.231303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.232897 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.234141 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-91c4effc-5e4c-4184-b961-5ec1b784f77c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.168572 Feb 12 04:21:56.234909 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 239/487] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:56 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:56.235386 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.241493 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.242416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.242935 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.385101 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.392558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d941e846-9fc1-4fb5-a60f-a52e9f993e8c tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.169395 Feb 12 04:21:56.393208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 249/488] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:56 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:56.578119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:56.578991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:56.586590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.587040 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.587844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:56.588278 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:56.734846 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:56.750435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-75ee5fee-9079-4c14-a652-46c09fef88b0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.176545 Feb 12 04:21:56.759813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 240/489] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:56 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:57.023285 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:57.024105 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:57.030979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.031427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.032212 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.032642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.206746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.217306 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7841d76c-511d-4899-8725-f834816ecebc tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.198333 Feb 12 04:21:57.227253 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 250/490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:57 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:57.251992 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:57.252622 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:57.258631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.259075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.259962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.260396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.405939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.409722 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:57.410337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:57.416028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.416922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.417395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.417567 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.418340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.418778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.418895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5ed4dd56-5480-40a4-a184-968a612fd757 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.170698 Feb 12 04:21:57.419574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 241/491] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:57 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:57.595237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.604940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-54bebef9-4bc5-4854-b51c-13a70642d2cb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.198791 Feb 12 04:21:57.614028 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 251/492] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:57 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:57.649583 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f13986d-5454-4efe-8fd7-bb63c7b6b903", "device": "/dev/sdb"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:21:57.654438 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:57.657957 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.658411 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.659205 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.659643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.767949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:57.768568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:57.775590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.776076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.776898 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:57.777376 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:57.912559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:57.920614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9bc21330-7bc8-4f6e-a94b-2ccfeb4b6967 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.156679 Feb 12 04:21:57.921184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 252/493] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:57 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:58.237672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:58.238785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:58.245883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.246333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.247133 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.247570 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.394897 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:58.402576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-81d8d637-dc41-4da4-9c9a-b1b0064ec454 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.170912 Feb 12 04:21:58.403179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 253/494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:58 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:58.436707 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:58.437330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:58.443602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.444050 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.445494 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.445920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.590932 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:58.599022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:58.600505 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:58.602424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a352eb26-5414-48e5-b553-9f4e3f4edd3e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.169360 Feb 12 04:21:58.602977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 254/495] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:58 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:21:58.622572 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:58.623187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:58.629623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.633433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.633433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.633433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.777654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:58.785327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b9e8599a-5330-40b2-8225-3b6530fd8bd7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.166265 Feb 12 04:21:58.786087 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 255/496] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:58 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:58.937798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:58.938539 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:58.945650 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.946181 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:58.947036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:58.947541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.329029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:59.338026 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-60c2aca6-3d71-4cec-9dda-8ed82c3d6c7c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.404207 Feb 12 04:21:59.338589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 256/497] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:58 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:21:59.420837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:59.421738 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:59.432695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.433660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.434901 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.435448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.600690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:59.610885 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-43d4ecf3-167e-4e5a-95e2-88f1f3570ef2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.194526 Feb 12 04:21:59.611875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 257/498] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:59 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:21:59.621177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:59.621977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:59.628707 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.634677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.634677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.634677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.795545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:59.805342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:59.806916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:21:59.808097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-729b2b1f-0fa6-409b-90fd-8bfb97d91579 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.191102 Feb 12 04:21:59.808652 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 258/499] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:21:59 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:21:59.821989 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:21:59.823101 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:21:59.830530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.831049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.831837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:21:59.832269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:21:59.992917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:00.004092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-82f9790c-eb8e-41bb-a314-114e48019c77 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.194397 Feb 12 04:22:00.004884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 259/500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:21:59 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:00.355400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:00.356167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:00.362444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.362893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.363673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.364110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.520896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:00.529749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-99ee65ee-c071-486a-89fa-9484ecdb9e39 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.178596 Feb 12 04:22:00.533466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 260/501] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:00 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:00.628083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:00.628736 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:00.635013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.635466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.636246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.636678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.788887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:00.797200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8c3f91d9-197f-4d68-ac15-c1c6dced2dca tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.173054 Feb 12 04:22:00.797845 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 261/502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:00 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:00.827559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:00.828182 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:00.834525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.835540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.836348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:00.836784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:00.994834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.003062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.005190 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.006438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8ca3f3a4-7927-4d1e-9614-1c80eec538bc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.182697 Feb 12 04:22:01.007243 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 262/503] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:00 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:01.021937 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:01.023452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:01.029867 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.030314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.031098 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.031533 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.199910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.207805 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-434b081d-3da2-403c-ae29-8e2fa88b24e1 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.189582 Feb 12 04:22:01.210768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 263/504] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:01 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:01.547613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:01.548286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:01.555349 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.555797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.557163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.557750 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.700432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.708573 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8ad1e6a3-f2a6-4b94-b1b1-9c2b75ce498c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.164752 Feb 12 04:22:01.718415 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 264/505] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:01 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:01.814131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:01.815013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:01.822892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.823432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.824565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:01.824896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:01.968169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:01.977345 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2e9a1188-dd86-48e6-b63a-c7371d999c82 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.166771 Feb 12 04:22:01.978164 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 265/506] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:01 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:02.024495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:02.025093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:02.031730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.032174 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.032949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.033427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.180014 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:02.189089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:02.190615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:02.191777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-afceffba-37f6-4939-9c9b-f4275dbdd86b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.171738 Feb 12 04:22:02.196784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 266/507] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:02 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:02.226865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:02.227513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:02.234057 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.234506 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.235294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.235729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.380333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:02.389360 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-54e19d29-efbd-436d-ae93-f0dc69cb13fa tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.166273 Feb 12 04:22:02.390112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 267/508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:02 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:02.726745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:02.727586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:02.734656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.735109 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.735901 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:02.736348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:02.892189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:02.901158 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-565ed2c7-dfa9-47f7-90a4-734d0dbac8df tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.179036 Feb 12 04:22:02.901774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 268/509] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:02 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:02.996130 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:02.996767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:03.002997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.003520 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.004217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.004644 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.144721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:03.152831 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-50c41977-f509-42c6-a2d4-28c52ca7a2f3 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.160598 Feb 12 04:22:03.153639 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 269/510] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:02 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:03.211180 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:03.211947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:03.224296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.224928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.225519 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.225960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.408551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:03.421656 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:03.424052 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:03.425487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f54cbb1e-ca28-4d5c-b265-aee2aebad9a7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.219345 Feb 12 04:22:03.426237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 270/511] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:03 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:03.431545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:03.432557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:03.440162 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.440162 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.441079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.441617 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.632902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:03.641668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-861b37be-eb6e-478d-b4aa-59cc9ed5b99d tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.213829 Feb 12 04:22:03.642610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 271/512] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:03 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:03.918373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:03.918989 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:03.925327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.925777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:03.926579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:03.927029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.073392 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.075256 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c3184942-7c1e-4ce2-97f7-4db2925e4846 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1721 microversion: 2.1 time: 0.160850 Feb 12 04:22:04.075841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 272/513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:03 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:04.169729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:04.170269 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:04.176004 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.176454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.177225 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.177758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.319320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.326710 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a0f834c8-5ab8-49d4-9b1a-837c3531ca2f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.160652 Feb 12 04:22:04.327280 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 273/514] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:04 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:04.446287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:04.446894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:04.456843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.456843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.456843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.456843 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.603569 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.612398 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.614049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.615229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-cac80269-10cd-4956-baac-20c2d874d59a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.174442 Feb 12 04:22:04.615999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 274/515] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:04 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:04.659805 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:04.660416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:04.666783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.667374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.671286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:04.671286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:04.812589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:04.821777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-de508108-a7d6-454d-9dc5-4cc902c9db95 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.165684 Feb 12 04:22:04.822357 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 275/516] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:04 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:05.013411 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1b3dc21a-8572-4a61-8f65-dd41db1928c4 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "POST /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.368352 Feb 12 04:22:05.014030 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 242/517] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:21:57 2022] POST /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e/os-volume_attachments => generated 194 bytes in 7370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:05.091970 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:05.092423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:05.099908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.101075 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.101926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.104705 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.239818 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.248192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3da2b4bd-4085-403a-93a7-616242a71402 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1698 microversion: 2.1 time: 0.160140 Feb 12 04:22:05.248834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 276/518] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:05 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:05.264898 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0711b629-dce9-46d7-b0ce-f5efc42b8a7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:05.270997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0711b629-dce9-46d7-b0ce-f5efc42b8a7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.271441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0711b629-dce9-46d7-b0ce-f5efc42b8a7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.330359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0711b629-dce9-46d7-b0ce-f5efc42b8a7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Going to try to start instance {{(pid=116750) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 04:22:05.343233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:05.343902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:05.349779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.350223 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.351044 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.351480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.491455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.499072 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4bdbb887-9a51-4653-9917-12b1c2f5b592 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.159469 Feb 12 04:22:05.499895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 277/519] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:05 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:05.532393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0711b629-dce9-46d7-b0ce-f5efc42b8a7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.271266 Feb 12 04:22:05.533409 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 243/520] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:22:05 2022] POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:22:05.541948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:05.542683 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:05.549966 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.550549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.551464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.552009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.636789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:05.637679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:05.644180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.644772 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.645699 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.646318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.731481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.740065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-510779ec-cbc1-4bad-bcc5-144531a7d28c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1707 microversion: 2.1 time: 0.202327 Feb 12 04:22:05.741372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 278/521] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:05 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1707 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:05.838510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:05.839296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:05.849548 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.851098 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.851690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.852773 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:05.853403 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:05.863517 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.863517 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:05.864965 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-933d77b5-412c-476c-8cf0-84f7183a338e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.232207 Feb 12 04:22:05.865580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 244/522] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:05 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:06.139833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:06.148690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8df121b7-d268-481a-80f9-aa7fe38915b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1513 microversion: 2.1 time: 0.314734 Feb 12 04:22:06.158768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 279/523] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:05 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:06.350142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-0b1565ec-4d85-4d91-adfc-c4b6077c8113 req-d413d7f5-785c-4182-b723-6c9112e9e6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33357a53-b2b2-4778-aeb1-ffe3f89c3699", "name": "network-vif-deleted", "tag": "c2ad8f86-26e5-4b78-89c3-4c6cf71428c8"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:06.352388 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:06.352388 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:22:06.359392 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0b1565ec-4d85-4d91-adfc-c4b6077c8113 req-d413d7f5-785c-4182-b723-6c9112e9e6f1 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.359838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0b1565ec-4d85-4d91-adfc-c4b6077c8113 req-d413d7f5-785c-4182-b723-6c9112e9e6f1 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.371384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-0b1565ec-4d85-4d91-adfc-c4b6077c8113 req-d413d7f5-785c-4182-b723-6c9112e9e6f1 service nova] Creating event network-vif-deleted:c2ad8f86-26e5-4b78-89c3-4c6cf71428c8 for instance 33357a53-b2b2-4778-aeb1-ffe3f89c3699 on hv-cinder-82869 Feb 12 04:22:06.376277 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-0b1565ec-4d85-4d91-adfc-c4b6077c8113 req-d413d7f5-785c-4182-b723-6c9112e9e6f1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029792 Feb 12 04:22:06.376877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 245/524] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:06.516325 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:06.517191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:06.526451 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.527137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.528628 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.529520 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.672878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:06.680704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ca06d4cd-00db-4437-8a4c-909cbd64cfd5 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1505 microversion: 2.1 time: 0.168533 Feb 12 04:22:06.681507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 280/525] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:06 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:06.760421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:06.761454 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:06.768239 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.768674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.769540 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.769978 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.883293 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:06.883962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:06.889797 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.890245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.891022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:06.891456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:06.914446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:06.919995 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ff5b30b4-ec96-4c57-8c30-816f25174a3e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1707 microversion: 2.1 time: 0.164254 Feb 12 04:22:06.920934 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 246/526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:06 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:07.030805 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:07.039091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:07.040601 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:07.041790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f0a6bacc-e507-4aa1-96e1-e767e9484f2f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.162780 Feb 12 04:22:07.042357 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 281/527] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:06 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:07.165743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:07.166359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:07.172251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.172696 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:07.173681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.174123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:07.233552 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:07.240779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-78d6cf62-8b5b-47ef-ad1a-a9c9b9a436d8 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1301 microversion: 2.1 time: 0.079185 Feb 12 04:22:07.242069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 247/528] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:07 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:07.697255 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:07.697887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:07.704209 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.704650 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:07.705452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.705889 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:07.764119 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:07.771313 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a0bae66b-259d-4c54-a354-4de465a81dcd tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1463 microversion: 2.1 time: 0.077750 Feb 12 04:22:07.771879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 282/529] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:07 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:07.936566 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:07.937174 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:07.943575 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.944021 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:07.945317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:07.945776 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.060133 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:08.060735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:08.066953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.067440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.068224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.068663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.082692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.092631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ff659512-8b0c-4fd8-9ab9-bc554cafbb14 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1707 microversion: 2.1 time: 0.159694 Feb 12 04:22:08.093208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 248/530] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:07 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:08.201786 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.210762 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.212271 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.213449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-30bb0df5-0c7f-4474-beda-10a3cbc0b2b3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.158145 Feb 12 04:22:08.214007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 283/531] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:08 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:08.257408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:08.258028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:08.263881 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.264319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.265092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.265626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.333674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.341166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a91d1183-c494-40c6-a475-464afca98e19 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1301 microversion: 2.1 time: 0.088104 Feb 12 04:22:08.341746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 249/532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:08 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:08.390875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-4a685e91-5b51-4e6f-8fad-70e6748eb77c req-f581f6a2-1cbb-4489-9c8b-307aa7a665d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde7f41-c793-4cdd-b9ac-94923b7ab588", "name": "network-vif-deleted", "tag": "1aa44ba5-96e3-4bef-be23-68c273fda544"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:08.392481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:08.392481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:22:08.399685 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-4a685e91-5b51-4e6f-8fad-70e6748eb77c req-f581f6a2-1cbb-4489-9c8b-307aa7a665d7 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.400124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-4a685e91-5b51-4e6f-8fad-70e6748eb77c req-f581f6a2-1cbb-4489-9c8b-307aa7a665d7 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.410610 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-4a685e91-5b51-4e6f-8fad-70e6748eb77c req-f581f6a2-1cbb-4489-9c8b-307aa7a665d7 service nova] Creating event network-vif-deleted:1aa44ba5-96e3-4bef-be23-68c273fda544 for instance adde7f41-c793-4cdd-b9ac-94923b7ab588 on hv-cinder-82869 Feb 12 04:22:08.416134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-4a685e91-5b51-4e6f-8fad-70e6748eb77c req-f581f6a2-1cbb-4489-9c8b-307aa7a665d7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028850 Feb 12 04:22:08.416992 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 284/533] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:08.789977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:08.790709 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:08.797264 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.797997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.801915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:08.801915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:08.866090 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:08.875534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fbf5a935-68c2-48d3-8604-0ca3320f3dcf tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1463 microversion: 2.1 time: 0.090430 Feb 12 04:22:08.876279 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 250/534] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:08 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:09.112822 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:09.113575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:09.119889 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.120329 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.121107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.121573 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.233077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:09.234955 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:09.242939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.243406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.244221 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.244742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.291975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.300347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-043c78f8-584c-41a5-9e01-8cfd815b1d2d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1707 microversion: 2.1 time: 0.194620 Feb 12 04:22:09.301249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 285/535] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:09 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1707 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:09.358150 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:09.358940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:09.364921 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.365421 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.366249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.366686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.398304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.406725 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.408161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.409375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1be2cb9a-50ba-4dc7-940e-cf786e0c75e1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.180361 Feb 12 04:22:09.410002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 251/536] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:09 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:09.427245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.434787 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-acdb692f-ef9f-4335-88c1-be68372bf53a tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1301 microversion: 2.1 time: 0.080640 Feb 12 04:22:09.436743 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 286/537] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:09 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:09.892759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:09.893394 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:09.899347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.899796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.900585 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.901393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.932174 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:09.932617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:09.933065 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'fault' on Instance uuid adde7f41-c793-4cdd-b9ac-94923b7ab588 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:09.974684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:09.982231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c80b3d20-b94a-4e13-8b57-af6f3a72bac8 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 200 len: 1310 microversion: 2.1 time: 0.093193 Feb 12 04:22:09.982788 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 252/538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:09 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:10.317183 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:10.317983 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:10.324735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.325258 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.326174 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.326717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.428748 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:10.429913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:10.436787 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.436985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.437809 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.438254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.477814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:10.495374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-08ee24a8-c8dd-4cd7-af3b-47bd4ff4b367 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1711 microversion: 2.1 time: 0.181891 Feb 12 04:22:10.497437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 287/539] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:10 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1711 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:10.500860 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:10.502450 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:10.509770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.510249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.511067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.511511 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.546868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:10.547379 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:10.547832 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'fault' on Instance uuid 33357a53-b2b2-4778-aeb1-ffe3f89c3699 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:10.598508 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:10.609109 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2ed58312-ef26-4b42-8865-79b940e61f88 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 200 len: 1306 microversion: 2.1 time: 0.111887 Feb 12 04:22:10.613800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 288/540] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:10 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:10.631790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:10.641080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:10.642627 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:10.643790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0894eb5d-3f42-42db-8749-d3bbd051c7e7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.219834 Feb 12 04:22:10.644348 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 253/541] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:10 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:22:10.999303 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:10.999904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: adde7f41-c793-4cdd-b9ac-94923b7ab588] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:11.005674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.006110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.007425 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.007851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.020554 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] HTTP exception thrown: Instance adde7f41-c793-4cdd-b9ac-94923b7ab588 could not be found. Feb 12 04:22:11.021127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Returning 404 to user: Instance adde7f41-c793-4cdd-b9ac-94923b7ab588 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:11.021950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e22d1b07-0965-4f0e-b968-5847b9347e09 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588" status: 404 len: 111 microversion: 2.1 time: 0.026363 Feb 12 04:22:11.023093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 289/542] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:10 2022] GET /compute/v2.1/servers/adde7f41-c793-4cdd-b9ac-94923b7ab588 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:11.031244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:11.031744 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:11.038635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.039069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.039851 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.040282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.065783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:22:11.357885 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-56c6bf6a-8473-46a3-b6b1-f250d6c067f6 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 204 len: 0 microversion: 2.1 time: 0.330178 Feb 12 04:22:11.358477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 254/543] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:22:11 2022] DELETE /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:22:11.366763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:11.368734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:11.373808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.374944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.376495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.376979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.514118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:11.521803 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-456ef629-fbc2-4ab5-853b-c995013a8388 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.159289 Feb 12 04:22:11.523835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 290/544] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:11 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:11.634783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:11.635481 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 33357a53-b2b2-4778-aeb1-ffe3f89c3699] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:11.641900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.642337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.643109 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.643540 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.658875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Instance 33357a53-b2b2-4778-aeb1-ffe3f89c3699 could not be found. Feb 12 04:22:11.659451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 404 to user: Instance 33357a53-b2b2-4778-aeb1-ffe3f89c3699 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:11.660259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-180c48b2-0570-4042-a5da-99317a7d45d2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699" status: 404 len: 111 microversion: 2.1 time: 0.030130 Feb 12 04:22:11.660781 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 255/545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:11 2022] GET /compute/v2.1/servers/33357a53-b2b2-4778-aeb1-ffe3f89c3699 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:11.662028 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:11.662637 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:11.668704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.669264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.669949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:11.670390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:11.806564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:11.814692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:11.816175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:11.817348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-35b73ccc-2e7b-4827-8332-0a4d29bffdd6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.158908 Feb 12 04:22:11.817900 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 291/546] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:11 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:12.538527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:12.539062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:12.544779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:12.545224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:12.546042 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:12.546473 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:12.678371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:12.685791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-99a0f5dd-fff3-4e1c-9557-a7fd290d2465 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.150998 Feb 12 04:22:12.686345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 256/547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:12 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:12.835835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:12.836468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:12.842783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:12.843235 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:12.844010 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:12.844448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:12.979778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:12.988657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:12.990335 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:12.991491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-bb3d7699-6a81-481d-ba9b-d589ecc0bdd2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.159461 Feb 12 04:22:12.992193 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 292/548] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:12 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:13.702561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:13.703087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:13.709451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:13.709894 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:13.710670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:13.711191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:13.840590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:13.847951 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d6ba072d-90de-4144-be8d-79e23ea3a59e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.149132 Feb 12 04:22:13.848517 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 257/549] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:13 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:14.008462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:14.009068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:14.015229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:14.015670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:14.016437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:14.016869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:14.153712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:14.161795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:14.163801 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:14.164940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-cfda6be1-7122-4bfc-9974-16714994d370 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.160101 Feb 12 04:22:14.165523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 293/550] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:14 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:14.866365 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:14.868155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:14.874739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:14.882261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:14.882261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:14.882261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.015568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:15.023519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f1875bee-a178-4185-9483-3e18647cf8f4 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.161472 Feb 12 04:22:15.024139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 258/551] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:14 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:15.068809 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:15.070022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:15.076661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.077184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.078008 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.078446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.103056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:22:15.181895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:15.182503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:15.188573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.189021 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.190638 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.191307 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.326336 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:15.337543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:15.337543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:15.338030 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d85347d9-113e-45b3-a7cf-ed8aedbb8d71 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.159871 Feb 12 04:22:15.345766 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 259/552] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:15 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:15.449084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-28f9116b-6593-4fb8-9ae2-7dd35ef15185 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 204 len: 0 microversion: 2.1 time: 0.383584 Feb 12 04:22:15.449725 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 294/553] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:22:15 2022] DELETE /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 04:22:15.457544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:15.458192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:15.464598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.465047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.465850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:15.466293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:15.603763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:15.611423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7846f6f0-425e-4381-9646-1010af3d787f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.157506 Feb 12 04:22:15.611970 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 260/554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:15 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:16.040861 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:16.041609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:16.047345 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.047793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.048612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.049047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.191811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:16.198268 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3cc32078-9536-410e-ae9e-f73253fded63 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.162001 Feb 12 04:22:16.198822 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 295/555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:16 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:16.356171 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:16.356854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:16.364086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.369685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.369685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.369685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.508555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:16.514585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-27193f1b-a958-40e0-a9a7-2ce4be6e2079 req-85879f26-3f7f-4415-8956-b50586415aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "name": "network-vif-plugged", "status": "completed", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:16.516427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:16.516427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:22:16.520168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:16.521913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:16.523842 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d24b370d-29ba-4403-96e3-8e437a346c69 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.171591 Feb 12 04:22:16.524369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 261/556] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:16 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:16.524525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-27193f1b-a958-40e0-a9a7-2ce4be6e2079 req-85879f26-3f7f-4415-8956-b50586415aef service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.524920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-27193f1b-a958-40e0-a9a7-2ce4be6e2079 req-85879f26-3f7f-4415-8956-b50586415aef service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.537902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-27193f1b-a958-40e0-a9a7-2ce4be6e2079 req-85879f26-3f7f-4415-8956-b50586415aef service nova] Creating event network-vif-plugged:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:22:16.542788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-27193f1b-a958-40e0-a9a7-2ce4be6e2079 req-85879f26-3f7f-4415-8956-b50586415aef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037592 Feb 12 04:22:16.543583 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 296/557] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:22:16.635357 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:16.635972 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:16.643258 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.643258 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.643589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:16.644022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:16.781550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:16.789605 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-73d4197e-51b4-46d7-800c-fee2a76530de tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.158505 Feb 12 04:22:16.793522 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 262/558] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:16 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:17.218175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:17.218893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:17.225364 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.226353 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.227122 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.227556 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.359689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:17.366922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a482bd36-0792-4c00-b739-7ab572bdd58f tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.152766 Feb 12 04:22:17.367469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 297/559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:17 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:17.541628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:17.542184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:17.548534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.548974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.549771 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.550203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.681986 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:17.690102 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:17.691594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:17.692726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-890a3295-2b8f-4ead-80d5-8173adde9fc8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.154953 Feb 12 04:22:17.693274 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 263/560] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:17 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:17.805961 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:17.806496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:17.812418 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.812874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.813660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:17.814093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:17.941737 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:17.949389 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-77afc76c-04a4-49fe-81dd-1fd3c9762b85 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.147116 Feb 12 04:22:17.949945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 298/561] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:17 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:18.383524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:18.384129 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:18.389998 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.390442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:18.391208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.391641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:18.523612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:18.530873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e251f96b-cf28-45f7-a129-96a96d20434d tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.150979 Feb 12 04:22:18.531428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 264/562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:18 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:18.715194 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:18.715792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:18.722008 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.722446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:18.723204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.723629 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:18.859854 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:18.868179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:18.869695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:18.870841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-85367bbb-1708-4b9b-8ea8-5bef482fd80e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.159370 Feb 12 04:22:18.871400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 299/563] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:18 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:18.966430 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:18.967055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:18.973371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.973820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:18.974590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:18.975023 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:19.109948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:19.119375 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-aae25fdc-e713-448d-8416-09306f70b9f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.156662 Feb 12 04:22:19.119947 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 265/564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:18 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:19.547719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:19.548323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:19.554818 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:19.555262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:19.556025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:19.556449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:19.698110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:19.705871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a591f2d5-b6f9-4281-b5bc-5632a2e7f74a tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.161811 Feb 12 04:22:19.708546 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 300/565] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:19 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:19.887974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:19.888775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:19.896054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:19.896500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:19.897806 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:19.898244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:20.040831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:20.049043 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:20.050533 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:20.051690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ece8b39a-7083-4183-8c7e-aa035776d498 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.167522 Feb 12 04:22:20.052236 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 266/566] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:19 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:20.143216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:20.143839 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:20.151427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:20.151877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:20.152654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:20.153085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:20.296155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:20.304291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7fcb743c-d776-4f7f-b4e3-98345289d5e6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.164296 Feb 12 04:22:20.304771 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 301/567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:20 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:20.723527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:20.724041 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:20.730834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:20.731282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:20.732056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:20.732509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:20.862584 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:20.869936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ff6bcfc0-ecf9-4116-8001-7bd47cb41e93 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.150133 Feb 12 04:22:20.870496 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 267/568] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:20 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:21.070614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:21.071230 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:21.077323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.077800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:21.078570 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.079000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:21.210499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:21.221383 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:21.222917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:21.224060 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-eca4ed62-14f1-4a5a-a033-3d2fc1ef48ac tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.158035 Feb 12 04:22:21.224605 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 302/569] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:21 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:21.320542 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:21.321223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:21.327432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.327875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:21.328639 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.329070 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:21.458753 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:21.466186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0df442c0-8c4c-498c-a132-eb27d552665f tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.149877 Feb 12 04:22:21.466745 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 268/570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:21 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:21.887031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:21.887639 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:21.893486 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.893928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:21.894688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:21.895120 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:22.024234 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:22.031654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d6bcccb8-de13-418d-b17d-4e0126380cd2 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.148225 Feb 12 04:22:22.032228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 303/571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:21 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:22.242592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:22.243112 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:22.248913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:22.249374 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:22.250129 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:22.250554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:22.381672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:22.389868 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:22.391388 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:22.392534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-44165604-153a-4d2c-9fb6-7befafa73429 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.153864 Feb 12 04:22:22.393087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 269/572] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:22 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:22.482815 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:22.483458 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:22.489760 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:22.490207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:22.491165 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:22.491627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:22.621421 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:22.628621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-345b48bb-000f-4dc5-8fb6-7131cb622c18 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.149781 Feb 12 04:22:22.629179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 304/573] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:22 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:23.049163 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:23.049728 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:23.056038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.056483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.057251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.057708 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.290975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:23.299009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-177ded1e-58ab-4da8-ac69-eb51668001db tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1521 microversion: 2.1 time: 0.253688 Feb 12 04:22:23.299640 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 270/574] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:23 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:23.411256 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:23.412113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:23.418031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.418686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.419586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.420224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.632072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-1d8f864f-5149-4b2d-b091-2c5088fa0ea8 req-fb38f6e4-9698-4059-a59c-b532442b362b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27b809-ac65-4266-99af-19350a4a9c03", "name": "network-vif-deleted", "tag": "d5e20402-d3d7-4588-9215-82923e13decf"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:23.634558 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:23.634558 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:22:23.642613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-1d8f864f-5149-4b2d-b091-2c5088fa0ea8 req-fb38f6e4-9698-4059-a59c-b532442b362b service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.643111 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-1d8f864f-5149-4b2d-b091-2c5088fa0ea8 req-fb38f6e4-9698-4059-a59c-b532442b362b service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.655256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-1d8f864f-5149-4b2d-b091-2c5088fa0ea8 req-fb38f6e4-9698-4059-a59c-b532442b362b service nova] Creating event network-vif-deleted:d5e20402-d3d7-4588-9215-82923e13decf for instance 5d27b809-ac65-4266-99af-19350a4a9c03 on hv-cinder-82869 Feb 12 04:22:23.660489 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-1d8f864f-5149-4b2d-b091-2c5088fa0ea8 req-fb38f6e4-9698-4059-a59c-b532442b362b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032696 Feb 12 04:22:23.661341 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 271/575] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:22:23.667347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:23.667825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:23.668032 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:23.674118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.674560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.675329 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.675816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.676513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:23.678046 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:23.681305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a9a1670d-bf4f-4fe0-8e13-0f7ce06429c2 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.272151 Feb 12 04:22:23.681305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 305/576] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:23 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:23.815987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:23.823974 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4e933893-a975-4011-a94e-9ad721620dc0 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1514 microversion: 2.1 time: 0.161280 Feb 12 04:22:23.824606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 272/577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:23 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:23.937775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-fcadbd31-56f1-408c-ab33-42179c21c074 req-a0a50da0-eeb3-41be-b047-9fe7a5a52046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d4c38d-1d35-40ba-90ca-76a76103873e", "name": "network-vif-deleted", "tag": "0aa7da43-7d38-403e-96e1-faec6f576040"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:23.939354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:23.939354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:22:23.946139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-fcadbd31-56f1-408c-ab33-42179c21c074 req-a0a50da0-eeb3-41be-b047-9fe7a5a52046 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:23.946581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-fcadbd31-56f1-408c-ab33-42179c21c074 req-a0a50da0-eeb3-41be-b047-9fe7a5a52046 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:23.956928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-fcadbd31-56f1-408c-ab33-42179c21c074 req-a0a50da0-eeb3-41be-b047-9fe7a5a52046 service nova] Creating event network-vif-deleted:0aa7da43-7d38-403e-96e1-faec6f576040 for instance c8d4c38d-1d35-40ba-90ca-76a76103873e on hv-cinder-82869 Feb 12 04:22:23.962191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-fcadbd31-56f1-408c-ab33-42179c21c074 req-a0a50da0-eeb3-41be-b047-9fe7a5a52046 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028024 Feb 12 04:22:23.962738 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 306/578] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:24.315843 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:24.316450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:24.322414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.322848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.323619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.324053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.383450 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:24.390874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c9237de3-f928-4f16-89ae-c3305293f0c7 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1479 microversion: 2.1 time: 0.078785 Feb 12 04:22:24.391446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 273/579] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:24 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1479 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:24.698484 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:24.699226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:24.705293 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.705750 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.706523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.706953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.840504 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:24.843763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:24.844372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:24.848758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:24.850829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:24.851193 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.851631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.851971 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c3c55c83-dea6-4072-8823-6f8d4089d693 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.158147 Feb 12 04:22:24.852394 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:24.852496 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 307/580] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:24 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:24.852823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:24.914856 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:24.924601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-acf87260-051b-4b73-ade1-31597c1cb76b tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1472 microversion: 2.1 time: 0.083786 Feb 12 04:22:24.925574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 274/581] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:24 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:25.408081 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:25.408634 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:25.415142 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.415572 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:25.416347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.416779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:25.475126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:25.483650 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a2b4539b-cfb5-445a-b76d-65859e48fd6e tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1306 microversion: 2.1 time: 0.079278 Feb 12 04:22:25.484203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 308/582] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:25 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1306 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:25.869960 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:25.870562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:25.876713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.877161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:25.879688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.881058 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:25.946174 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:25.946965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:25.957967 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.962614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:25.962614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:25.962614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:26.042881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:26.051975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-689194bc-5b42-4908-8e07-351866efa790 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 200 len: 1303 microversion: 2.1 time: 0.113651 Feb 12 04:22:26.053175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 309/583] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:25 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:26.072704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:26.081194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:26.083793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:26.084038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1d3b28eb-3f56-4907-9cf8-d78a65ef7c94 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.218279 Feb 12 04:22:26.084600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 275/584] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:25 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:26.511745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:26.512371 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:26.518802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:26.519305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:26.520078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:26.520501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:26.553167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:26.553655 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:26.554107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lazy-loading 'fault' on Instance uuid 5d27b809-ac65-4266-99af-19350a4a9c03 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:26.596259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12659c94a0e54cb885e5398cd4ce4469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b322dc86ac594838a4aebaf0645d9c21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:26.603620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-95d38996-8023-422c-80f9-29d93df15d51 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 200 len: 1311 microversion: 2.1 time: 0.096600 Feb 12 04:22:26.604191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 310/585] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:26 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:27.067690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:27.068303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: c8d4c38d-1d35-40ba-90ca-76a76103873e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:27.074500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.074945 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.075719 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.076151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.089433 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Instance c8d4c38d-1d35-40ba-90ca-76a76103873e could not be found. Feb 12 04:22:27.091387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 404 to user: Instance c8d4c38d-1d35-40ba-90ca-76a76103873e could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:27.091387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-475fd299-5aa3-4755-ac7d-3965034d8ab2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e" status: 404 len: 111 microversion: 2.1 time: 0.026993 Feb 12 04:22:27.091686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 276/586] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:27 2022] GET /compute/v2.1/servers/c8d4c38d-1d35-40ba-90ca-76a76103873e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:27.100547 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:27.101035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:27.104867 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:27.105609 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:27.111932 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.112372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.113145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.113608 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.121020 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.123350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.124163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.124620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.150011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:22:27.264666 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:27.272953 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:27.275468 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:27.276590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1de44837-5f12-4228-ab4a-015ad3911a28 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.178365 Feb 12 04:22:27.277147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 277/587] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:27 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:27.464637 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-902cac57-1afe-49cc-9223-4c792c6151b6 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 204 len: 0 microversion: 2.1 time: 0.368626 Feb 12 04:22:27.465218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 311/588] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:22:27 2022] DELETE /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:22:27.472995 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:27.473636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:27.479601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.480037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.481113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.481570 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.611042 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:27.619459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-442a0b9c-9c62-49b0-b666-de55bb1b42e2 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1513 microversion: 2.1 time: 0.150107 Feb 12 04:22:27.625571 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 278/589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:27 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:27.625734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:27.625734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] [instance: 5d27b809-ac65-4266-99af-19350a4a9c03] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:27.629100 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.629891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.630717 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:27.631155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:27.645339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] HTTP exception thrown: Instance 5d27b809-ac65-4266-99af-19350a4a9c03 could not be found. Feb 12 04:22:27.645975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] Returning 404 to user: Instance 5d27b809-ac65-4266-99af-19350a4a9c03 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:27.646817 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-657e5844-523c-4140-b850-0e59648cda62 tempest-ServerRescueNegativeTestJSON-532357 tempest-ServerRescueNegativeTestJSON-532357-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03" status: 404 len: 111 microversion: 2.1 time: 0.029973 Feb 12 04:22:27.647304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 312/590] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:27 2022] GET /compute/v2.1/servers/5d27b809-ac65-4266-99af-19350a4a9c03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:22:28.294390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:28.295613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:28.301918 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:28.302367 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:28.303145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:28.303756 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:28.443658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:28.452594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:28.454271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:28.455523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-72a7b8c5-1ad6-4904-90df-fa25cc43159c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.164852 Feb 12 04:22:28.456176 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 279/591] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:28 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:28.636407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:28.637038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:28.643249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:28.643689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:28.644452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:28.644878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:28.777469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:28.784763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3fa2cfdd-9a60-4959-831c-254e8e3f0787 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1513 microversion: 2.1 time: 0.152631 Feb 12 04:22:28.785449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 313/592] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:28 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:29.474423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:29.475086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:29.482345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:29.483006 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:29.483775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:29.484359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:29.804429 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:29.806218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:29.820545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:29.823165 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:29.824798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:29.830588 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:29.855088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:29.864118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:29.866244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:29.867777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-887c94c0-a111-4c96-a282-0f38b2f364ea tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1809 microversion: 2.20 time: 0.397041 Feb 12 04:22:29.868570 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 280/593] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:29 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:30.024129 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:30.031804 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a89901ea-1671-4163-a504-17b4243d7900 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1513 microversion: 2.1 time: 0.232965 Feb 12 04:22:30.035883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 314/594] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:29 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:30.886426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:30.887077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:30.893562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:30.894003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:30.895378 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:30.895811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:31.048221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:31.048971 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:31.058326 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:31.059075 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:31.060162 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:31.060784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:31.061593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:31.071041 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:31.072545 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:31.074056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b759de8e-5025-4504-86a5-ff1fc050e715 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1796 microversion: 2.20 time: 0.192013 Feb 12 04:22:31.074804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 281/595] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:22:30 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1796 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:22:31.265085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:31.272377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-dd30d707-c9c8-4263-a776-adad75c8e1b7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1513 microversion: 2.1 time: 0.228093 Feb 12 04:22:31.272943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 315/596] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:31 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:32.291225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:32.292780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:32.299386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:32.300073 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:32.300909 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:32.301546 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:32.482458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:32.494154 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-dd2243e6-a5f3-439e-8bbc-4253af031f72 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1513 microversion: 2.1 time: 0.208238 Feb 12 04:22:32.495069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 282/597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:32 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:32.538795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-3374d802-2982-47cf-a880-2003f41ae1e4 req-02708ef4-4848-429a-880d-a91e206b02a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfd8430-8109-4f4b-99f3-7d755f2849f0", "name": "network-vif-deleted", "tag": "c91616f2-77ab-40c0-8485-6ee07fabecae"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:32.540906 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:32.540906 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:22:32.549591 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-3374d802-2982-47cf-a880-2003f41ae1e4 req-02708ef4-4848-429a-880d-a91e206b02a9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:32.554697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-3374d802-2982-47cf-a880-2003f41ae1e4 req-02708ef4-4848-429a-880d-a91e206b02a9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:32.562938 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-3374d802-2982-47cf-a880-2003f41ae1e4 req-02708ef4-4848-429a-880d-a91e206b02a9 service nova] Creating event network-vif-deleted:c91616f2-77ab-40c0-8485-6ee07fabecae for instance 2bfd8430-8109-4f4b-99f3-7d755f2849f0 on hv-cinder-82869 Feb 12 04:22:32.568459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-3374d802-2982-47cf-a880-2003f41ae1e4 req-02708ef4-4848-429a-880d-a91e206b02a9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033119 Feb 12 04:22:32.569472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 316/598] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:33.313684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c09591ab-f16a-48b5-8ba1-04a46cc768c7 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Action: 'create', calling method: .version_select at 0x7f8e6839a160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1009870680", "metadata": {"Type": "work"}}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:33.315147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c09591ab-f16a-48b5-8ba1-04a46cc768c7 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.315951 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c09591ab-f16a-48b5-8ba1-04a46cc768c7 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.113630 Feb 12 04:22:33.316471 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 283/599] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 04:22:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:22:33.325795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-71357d8f-119a-472f-a1d3-8d779974d367 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Action: 'create', calling method: .version_select at 0x7f8e6905c820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1072150037", "metadata": {"Type": "work"}}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:33.327174 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-71357d8f-119a-472f-a1d3-8d779974d367 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.327955 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-71357d8f-119a-472f-a1d3-8d779974d367 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006294 Feb 12 04:22:33.328452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 317/600] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 04:22:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:22:33.336420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fdba8baa-960b-4a99-b8f2-3633b3822c45 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Action: 'create', calling method: .version_select at 0x7f8e68360160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-874796935", "metadata": {"Type": "work"}}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:33.338040 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fdba8baa-960b-4a99-b8f2-3633b3822c45 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.338813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fdba8baa-960b-4a99-b8f2-3633b3822c45 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005838 Feb 12 04:22:33.341528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 284/601] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 04:22:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 04:22:33.349134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-259c0f39-07a3-4e84-98f5-4a74b28d0a75 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Calling method '.version_select at 0x7f8e68ceb790>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:33.380115 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-259c0f39-07a3-4e84-98f5-4a74b28d0a75 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] HTTP exception thrown: Volume tempest-invalid-192421769 could not be found. Feb 12 04:22:33.380736 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-259c0f39-07a3-4e84-98f5-4a74b28d0a75 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 404 to user: Volume tempest-invalid-192421769 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.382228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-259c0f39-07a3-4e84-98f5-4a74b28d0a75 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-192421769" status: 404 len: 98 microversion: 2.1 time: 0.035705 Feb 12 04:22:33.382774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 318/602] 10.222.0.31 () {58 vars in 1214 bytes} [Sat Feb 12 04:22:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-192421769 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 04:22:33.391987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a97ffe44-43db-44fe-be2a-dab78854559c tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003517 Feb 12 04:22:33.392502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 285/603] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 04:22:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 04:22:33.400608 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ad05750c-b517-4427-8cb2-863045c57850 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003403 Feb 12 04:22:33.401094 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 319/604] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 04:22:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 04:22:33.408429 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1f1e859b-ad9a-4297-a0cc-38d421bd3e64 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Calling method '.version_select at 0x7f8e6839ad30>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:33.433980 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-1f1e859b-ad9a-4297-a0cc-38d421bd3e64 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] HTTP exception thrown: Volume 59f225b7-5e0a-47ed-871f-c1f0233f3603 could not be found. Feb 12 04:22:33.434562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1f1e859b-ad9a-4297-a0cc-38d421bd3e64 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 404 to user: Volume 59f225b7-5e0a-47ed-871f-c1f0233f3603 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.435366 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1f1e859b-ad9a-4297-a0cc-38d421bd3e64 tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/59f225b7-5e0a-47ed-871f-c1f0233f3603" status: 404 len: 109 microversion: 2.1 time: 0.030082 Feb 12 04:22:33.435887 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 286/605] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:22:33 2022] DELETE /compute/v2.1/os-volumes/59f225b7-5e0a-47ed-871f-c1f0233f3603 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:33.444306 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4f37d42a-dbb9-472a-9a61-e5641157c07d tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Calling method '.version_select at 0x7f8e690f33a0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:33.470671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-4f37d42a-dbb9-472a-9a61-e5641157c07d tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] HTTP exception thrown: Volume 49000a9a-eacc-4e61-a90c-4430aa2a584a could not be found. Feb 12 04:22:33.471271 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4f37d42a-dbb9-472a-9a61-e5641157c07d tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] Returning 404 to user: Volume 49000a9a-eacc-4e61-a90c-4430aa2a584a could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:33.472151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4f37d42a-dbb9-472a-9a61-e5641157c07d tempest-VolumesNegativeTest-1751488561 tempest-VolumesNegativeTest-1751488561-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/49000a9a-eacc-4e61-a90c-4430aa2a584a" status: 404 len: 109 microversion: 2.1 time: 0.031350 Feb 12 04:22:33.472681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 320/606] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 04:22:33 2022] GET /compute/v2.1/os-volumes/49000a9a-eacc-4e61-a90c-4430aa2a584a => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:33.511363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:33.512002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:33.518394 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:33.518843 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:33.519673 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:33.520054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:33.590681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:33.590681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e352a507-f294-4d2a-a3f5-98c63fb60684 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1302 microversion: 2.1 time: 0.082613 Feb 12 04:22:33.590963 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 287/607] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:33 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:34.611551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:34.614177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:34.624100 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:34.624559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:34.625399 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:34.625901 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:34.668080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:34.672668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:34.672668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'fault' on Instance uuid 2bfd8430-8109-4f4b-99f3-7d755f2849f0 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:34.717393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:34.726001 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-335129c3-dbf9-44d5-ab21-e81cb700bd5e tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 200 len: 1307 microversion: 2.1 time: 0.123172 Feb 12 04:22:34.726752 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 321/608] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:34 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:35.744392 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:35.744959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 2bfd8430-8109-4f4b-99f3-7d755f2849f0] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:35.751717 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:35.752166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:35.752940 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:35.753415 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:35.770555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Instance 2bfd8430-8109-4f4b-99f3-7d755f2849f0 could not be found. Feb 12 04:22:35.771148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 404 to user: Instance 2bfd8430-8109-4f4b-99f3-7d755f2849f0 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:35.771985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7f94f639-3cfb-4e38-91e3-74a435ebfedc tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0" status: 404 len: 111 microversion: 2.1 time: 0.031893 Feb 12 04:22:35.776050 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 288/609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:35 2022] GET /compute/v2.1/servers/2bfd8430-8109-4f4b-99f3-7d755f2849f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:37.173456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:37.173973 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:37.183125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.183125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:37.183995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.184874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:37.201204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:37.202927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:37.209109 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.209575 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:37.210557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.211148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:37.212071 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:22:37.296030 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lazy-loading 'services' on Instance uuid 4962f036-56e6-4737-8652-dad9f205453e {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:37.768794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4adc56b6-17e4-4834-8243-d93cb248d0cc tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e/os-volume_attachments/4f13986d-5454-4efe-8fd7-bb63c7b6b903" status: 202 len: 0 microversion: 2.1 time: 0.571581 Feb 12 04:22:37.769506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 289/610] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:22:37 2022] DELETE /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e/os-volume_attachments/4f13986d-5454-4efe-8fd7-bb63c7b6b903 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:22:37.918318 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-beab373f-1470-4816-bc42-cc8b21bb49f7 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "DELETE /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 204 len: 0 microversion: 2.1 time: 0.748362 Feb 12 04:22:37.918926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 322/611] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:22:37 2022] DELETE /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:22:37.927227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:37.927914 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:37.934782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.935250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:37.936008 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:37.936440 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:38.076034 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:38.083694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4d1e42f9-3465-47cd-949d-5593fb24ffcf tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1514 microversion: 2.1 time: 0.160503 Feb 12 04:22:38.084258 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 290/612] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:37 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:39.100465 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:39.101189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:39.107648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:39.108243 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:39.109089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:39.109557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:39.287827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:39.296602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f27e7cdf-cc40-46f0-b0df-90d1c6effa65 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1514 microversion: 2.1 time: 0.200349 Feb 12 04:22:39.297647 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 323/613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:39 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:40.314539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:40.315232 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:40.323309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:40.323309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:40.323309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:40.323309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:40.549308 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:40.557524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-99077403-2009-4b42-beb9-ce4260d16984 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1514 microversion: 2.1 time: 0.246839 Feb 12 04:22:40.558102 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 291/614] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:40 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:40.988769 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:40.989358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:40.996466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:40.996913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:40.997752 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:40.998169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:41.028391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:22:41.380992 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-957c7f81-6de1-4769-9a33-6081705c9200 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 204 len: 0 microversion: 2.1 time: 0.395760 Feb 12 04:22:41.385014 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 324/615] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:22:40 2022] DELETE /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:22:41.390306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:41.390908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:41.397175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:41.397650 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:41.398525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:41.398967 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:41.537347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:41.545153 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2561c3ee-05c0-4525-a870-6b3e16730e34 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1512 microversion: 2.1 time: 0.158626 Feb 12 04:22:41.545739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 292/616] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:41 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:41.573543 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:41.574241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:41.580151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:41.580590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:41.581400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:41.581813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:41.726586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:41.734230 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-434e8a2e-08c9-4e84-9d64-17592588eebb tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1514 microversion: 2.1 time: 0.164774 Feb 12 04:22:41.734792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 325/617] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:41 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:42.387679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-9d3446ab-3318-480c-9ea4-91dab4683164 req-37e6a18a-258e-4822-af58-9040693235e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d39788-4a0a-4590-811a-bda70e802bc8", "name": "network-vif-deleted", "tag": "28c9098c-2911-456c-a866-c46cf15a8c35"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:42.387679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:42.387679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:22:42.389321 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-9d3446ab-3318-480c-9ea4-91dab4683164 req-37e6a18a-258e-4822-af58-9040693235e3 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.389799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-9d3446ab-3318-480c-9ea4-91dab4683164 req-37e6a18a-258e-4822-af58-9040693235e3 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.401435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-9d3446ab-3318-480c-9ea4-91dab4683164 req-37e6a18a-258e-4822-af58-9040693235e3 service nova] Creating event network-vif-deleted:28c9098c-2911-456c-a866-c46cf15a8c35 for instance 30d39788-4a0a-4590-811a-bda70e802bc8 on hv-cinder-82869 Feb 12 04:22:42.406346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-9d3446ab-3318-480c-9ea4-91dab4683164 req-37e6a18a-258e-4822-af58-9040693235e3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Feb 12 04:22:42.407171 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 293/618] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:42.562208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:42.562793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:42.569037 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.569524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.570284 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.570716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.709253 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:42.717769 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f99f8f05-7199-4534-8eec-94dd8201d3d7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1512 microversion: 2.1 time: 0.159321 Feb 12 04:22:42.724461 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 326/619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:42 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:42.751505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:42.752186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:42.758960 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.767441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.767441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.767441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.790987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:42.791484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:42.791960 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lazy-loading 'fault' on Instance uuid 30d39788-4a0a-4590-811a-bda70e802bc8 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:42.833069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3609a9d4fe144b68a62ad4696301244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fece42b3279f4d4aac21d7922c52c5ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:42.840214 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6a4e2f33-e4a5-4f9a-8335-8ca62121b553 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 200 len: 1308 microversion: 2.1 time: 0.092650 Feb 12 04:22:42.840779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 294/620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:42 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:43.735132 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:43.735934 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:43.742377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:43.742907 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:43.743670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:43.744094 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:43.856993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:43.857780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] [instance: 30d39788-4a0a-4590-811a-bda70e802bc8] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:43.864077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:43.864619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:43.865443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:43.865950 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:43.879320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] HTTP exception thrown: Instance 30d39788-4a0a-4590-811a-bda70e802bc8 could not be found. Feb 12 04:22:43.880704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] Returning 404 to user: Instance 30d39788-4a0a-4590-811a-bda70e802bc8 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:43.880919 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5733495b-0b31-4d62-99b5-eb0e172fda45 tempest-AttachVolumeNegativeTest-324724247 tempest-AttachVolumeNegativeTest-324724247-project] 10.222.0.31 "GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8" status: 404 len: 111 microversion: 2.1 time: 0.028596 Feb 12 04:22:43.881372 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 295/621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:43 2022] GET /compute/v2.1/servers/30d39788-4a0a-4590-811a-bda70e802bc8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:22:43.991868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:43.999642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-98874905-f296-4060-9743-debad8c81ac6 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1512 microversion: 2.1 time: 0.268505 Feb 12 04:22:44.000734 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 327/622] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:43 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:44.423022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-1ba65674-43c4-435a-85c8-54995895f70f req-79c25b2b-ca3d-480e-a69d-54f14b68d608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4962f036-56e6-4737-8652-dad9f205453e", "name": "network-vif-deleted", "tag": "aeb35bd6-6f27-4770-be83-8e67439cf22d"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:44.425538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:22:44.425538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:22:44.433827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-1ba65674-43c4-435a-85c8-54995895f70f req-79c25b2b-ca3d-480e-a69d-54f14b68d608 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:44.434519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-1ba65674-43c4-435a-85c8-54995895f70f req-79c25b2b-ca3d-480e-a69d-54f14b68d608 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:44.452568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-1ba65674-43c4-435a-85c8-54995895f70f req-79c25b2b-ca3d-480e-a69d-54f14b68d608 service nova] Creating event network-vif-deleted:aeb35bd6-6f27-4770-be83-8e67439cf22d for instance 4962f036-56e6-4737-8652-dad9f205453e on hv-cinder-82869 Feb 12 04:22:44.458281 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-1ba65674-43c4-435a-85c8-54995895f70f req-79c25b2b-ca3d-480e-a69d-54f14b68d608 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039008 Feb 12 04:22:44.459316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 296/623] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:22:45.016674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:45.017309 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:45.024155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:45.025199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:45.026149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:45.026865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:45.061154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:45.062319 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:45.062902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lazy-loading 'fault' on Instance uuid 4962f036-56e6-4737-8652-dad9f205453e {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:22:45.116999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:45.126265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-83fd7041-7c4c-428e-b183-8d8a69468aca tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 200 len: 1307 microversion: 2.1 time: 0.113178 Feb 12 04:22:45.126860 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 328/624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:45 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:46.144560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:46.145199 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 4962f036-56e6-4737-8652-dad9f205453e] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:46.151791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:46.152239 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:46.153026 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:46.153565 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:46.167547 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] HTTP exception thrown: Instance 4962f036-56e6-4737-8652-dad9f205453e could not be found. Feb 12 04:22:46.168139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Returning 404 to user: Instance 4962f036-56e6-4737-8652-dad9f205453e could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:22:46.168962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1dd60c27-0fa0-4474-acf7-e964df982c2e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e" status: 404 len: 111 microversion: 2.1 time: 0.028965 Feb 12 04:22:46.169538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 297/625] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:46 2022] GET /compute/v2.1/servers/4962f036-56e6-4737-8652-dad9f205453e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:47.660510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:47.661521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:47.668707 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:47.669149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:47.669973 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:47.670398 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:47.984568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d89e2c46-b120-4564-86da-a7cf71d1859d tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action" status: 202 len: 0 microversion: 2.1 time: 0.327587 Feb 12 04:22:47.985765 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 329/626] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:22:47 2022] POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:22:47.994250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:47.995014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:48.019633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:48.019633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:48.019633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:48.019633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:48.163230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:48.172518 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3c52d9b4-9e29-40e2-bf73-0c43db860acf tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1750 microversion: 2.1 time: 0.182729 Feb 12 04:22:48.173649 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 298/627] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:47 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:49.192041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:49.193126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:49.199744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:49.200192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:49.201026 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:49.204563 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:49.369686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:49.378590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9e1471a8-440a-48f2-af4c-ff46024022b9 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1750 microversion: 2.1 time: 0.190648 Feb 12 04:22:49.379153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 330/628] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:49 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:50.395539 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:50.396179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:50.403903 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:50.404252 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:50.405023 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:50.405486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:50.567389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:50.575827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a43502dc-1609-4065-9f42-f678ed48b97a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1750 microversion: 2.1 time: 0.184006 Feb 12 04:22:50.576694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 299/629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:50 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:51.592227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:51.592880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:51.599037 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:51.602779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:51.602779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:51.602779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:51.742837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:51.751148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-63cd5e06-5a8e-49a7-917e-49719dfa142a tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.162520 Feb 12 04:22:51.751715 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 331/630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:51 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:52.768645 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:52.769314 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:52.776062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:52.776509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:52.777295 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:52.777727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:52.949148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:52.957495 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fb9a3318-ce90-43c5-9a2e-3e782c4b0039 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.192258 Feb 12 04:22:52.957792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 300/631] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:52 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:53.974218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:53.974928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:53.981441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:53.981891 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:53.982740 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:53.983166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:54.140918 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:54.148691 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c97bde94-f4e3-44ff-9b3f-58f295903575 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.178120 Feb 12 04:22:54.149243 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 332/632] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:53 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:55.166417 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:55.170920 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:55.174081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:55.174696 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:55.175689 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:55.176126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:55.411456 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:55.434078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9171553c-08b5-4d7c-a6e9-da3787403009 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.265552 Feb 12 04:22:55.434757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 301/633] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:55 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:56.451474 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:56.452236 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:56.459160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:56.459842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:56.460812 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:56.461250 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:56.640361 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:56.652229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0e3657bd-e7be-4129-a8f7-c1b92614a42f tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.204285 Feb 12 04:22:56.652783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 333/634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:56 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:57.057231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-109978814", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "1b4c56bc-a8c6-4d19-a027-a619a25face0"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:22:57.114635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] validate_networks() for [('1b4c56bc-a8c6-4d19-a027-a619a25face0', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:22:57.484976 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:22:57.485428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:22:57.485889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:22:57.486286 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:22:57.486686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:22:57.496093 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:57.496544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:57.497341 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:57.497793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:57.515749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Getting quotas for project 2c9d14816d4e4f7c9fdd17604fe92747. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:22:57.520030 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Getting quotas for user 5b5c229e1d0c4da7bc08c068d087a6bc and project 2c9d14816d4e4f7c9fdd17604fe92747. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:22:57.530879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:22:57.536509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:22:57.669431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:57.670022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:57.677997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:57.678134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:57.678824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:57.679411 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:57.703292 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4bc3edda-f6bd-403f-9f02-44f159986e18 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650076 Feb 12 04:22:57.705543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 302/635] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 04:22:57.720513 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cec08e28-f3b9-49ea-aea8-a40f7a768c84 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:57.721132 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cec08e28-f3b9-49ea-aea8-a40f7a768c84 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:57.809326 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cec08e28-f3b9-49ea-aea8-a40f7a768c84 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:57.816775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cec08e28-f3b9-49ea-aea8-a40f7a768c84 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1218 microversion: 2.1 time: 0.100740 Feb 12 04:22:57.817661 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 303/636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:57 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:57.964586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:57.972576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-94e1b45d-776f-48d2-87f1-e498c5e5df20 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.307118 Feb 12 04:22:57.974777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 334/637] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:57 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:58.833947 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:58.834437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:58.851498 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:58.851935 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:58.852759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:58.853804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:58.922293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:58.929612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-22b90d3d-dfb7-4635-ac27-b9f991a3a282 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1222 microversion: 2.1 time: 0.099395 Feb 12 04:22:58.930210 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 304/638] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:58 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:22:58.994623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:58.995362 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:59.002633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:59.003095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:59.003877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:59.004312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:59.186199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:22:59.200069 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-956cedc7-01ca-4acb-ba44-0fd231f53f80 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.209738 Feb 12 04:22:59.201103 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 335/639] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:58 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:22:59.946078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:22:59.946713 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:22:59.953011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:59.953531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:22:59.954300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:22:59.954898 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:00.045510 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:00.057259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-29ba3a4f-1792-4628-afd7-930728a02b2a tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1270 microversion: 2.1 time: 0.114074 Feb 12 04:23:00.058021 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 305/640] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:22:59 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:00.217120 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:00.217944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:00.226908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:00.227368 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:00.228355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:00.228796 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:00.459641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:00.468370 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c1d8bec6-470a-40e1-a1a2-fad4cb524e14 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.254966 Feb 12 04:23:00.469055 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 336/641] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:00 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:01.079542 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:01.080159 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:01.086103 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:01.086547 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:01.087412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:01.087844 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:01.382155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:01.396323 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ebda5eec-388d-46fc-bd49-2d8e9de20623 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.320243 Feb 12 04:23:01.397437 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 306/642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:01 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:01.485554 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:01.486148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:01.492418 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:01.492903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:01.494328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:01.494767 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:01.773800 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:01.782342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4e92eec4-502b-4e65-a44d-339dbb0e0258 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.300968 Feb 12 04:23:01.782934 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 337/643] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:01 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:02.413060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:02.413706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:02.420731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.421777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.423600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.424487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.512452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-f89639f2-3c0f-4507-81f6-a49ce7d6a4c3 req-b8364614-326e-4bfe-8809-16c16a6b4aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef7cee0-0173-4a04-856c-7bcd7430449d", "tag": "ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:02.519786 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:02.519786 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:23:02.522301 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f89639f2-3c0f-4507-81f6-a49ce7d6a4c3 req-b8364614-326e-4bfe-8809-16c16a6b4aef service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.522747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-f89639f2-3c0f-4507-81f6-a49ce7d6a4c3 req-b8364614-326e-4bfe-8809-16c16a6b4aef service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.537041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-f89639f2-3c0f-4507-81f6-a49ce7d6a4c3 req-b8364614-326e-4bfe-8809-16c16a6b4aef service nova] Creating event network-changed:ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa for instance 5ef7cee0-0173-4a04-856c-7bcd7430449d on hv-cinder-82869 Feb 12 04:23:02.542848 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-f89639f2-3c0f-4507-81f6-a49ce7d6a4c3 req-b8364614-326e-4bfe-8809-16c16a6b4aef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037759 Feb 12 04:23:02.543826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 338/644] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:23:02.639048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:02.639620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:02.648384 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.649570 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.650152 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.650689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.671056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:02.683017 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-953be21b-eac1-4341-a301-98fa2abfa260 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.273366 Feb 12 04:23:02.695594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 307/645] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:02 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:02.752424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lazy-loading 'services' on Instance uuid b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:23:02.800794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:02.801989 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:02.808940 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.809421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:02.810213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:02.810679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:03.054460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-630f5919-7a90-4a56-b4ef-8999b3a06915 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments/932a0f70-0de7-4f4c-8743-edcd5e47ef4a" status: 202 len: 0 microversion: 2.1 time: 0.419814 Feb 12 04:23:03.055245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 339/646] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:23:02 2022] DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments/932a0f70-0de7-4f4c-8743-edcd5e47ef4a => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:23:03.072413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:03.082211 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f6e8c345-0032-497f-a061-eb1fa14a888c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.284915 Feb 12 04:23:03.089194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 308/647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:02 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:03.702789 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:03.703490 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:03.710093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:03.710544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:03.711350 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:03.711788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:03.848401 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:03.857015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-713c9fc7-e5cd-4f26-a0b4-558b877d7c1d tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.158092 Feb 12 04:23:03.857596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 340/648] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:03 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:04.098596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:04.099231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:04.105381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.105828 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.106853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.107286 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.251804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:04.259814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9150a05f-30dc-437e-9f3f-0f8cce402f32 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.165053 Feb 12 04:23:04.260551 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 309/649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:04 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:04.469355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e33dbcda-7011-4cde-834e-49b795b370f5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:04.479037 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e33dbcda-7011-4cde-834e-49b795b370f5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.479530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e33dbcda-7011-4cde-834e-49b795b370f5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.502943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e33dbcda-7011-4cde-834e-49b795b370f5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Going to try to stop instance {{(pid=116751) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 04:23:04.715293 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e33dbcda-7011-4cde-834e-49b795b370f5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.255314 Feb 12 04:23:04.716144 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 341/650] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:23:04 2022] POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:23:04.724525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:04.725132 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:04.730993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.731697 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.732474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.732901 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.868568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:04.874203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:04.874905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:04.875895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-65333d74-13e8-41f0-9d37-75fcdcac47c3 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.154913 Feb 12 04:23:04.876449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 310/651] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:04 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:04.880829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.881290 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:04.882080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:04.882513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:05.021953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:05.029855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7bdf6ba7-8418-497e-ae7f-c63a50584634 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.159788 Feb 12 04:23:05.030427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 342/652] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:04 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:05.279679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:05.280268 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:05.289020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:05.289515 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:05.290303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:05.290738 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:05.440689 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:05.449315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d923fcb4-b912-4193-8c31-90f7cbd6c1e2 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.175611 Feb 12 04:23:05.449947 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 311/653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:05 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:05.893148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:05.894124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:05.905332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:05.905779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:05.906571 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:05.907004 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:06.049198 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:06.050272 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:06.050948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:06.057863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c5ea4fcc-caa7-46c8-be4c-6786b5e57ccb tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.168352 Feb 12 04:23:06.058302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:06.058649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 343/654] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:05 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:06.067669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:06.068549 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:06.068999 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:06.200134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:06.207906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-00225bcf-7cf0-489c-a394-29ef8d91c6ba tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.164260 Feb 12 04:23:06.208462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 312/655] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:06 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:06.467672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:06.468287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:06.474255 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:06.474704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:06.475493 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:06.475930 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:06.646159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:06.654827 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6518f01a-c00a-4099-af77-d8b5664495e3 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1755 microversion: 2.1 time: 0.190836 Feb 12 04:23:06.655398 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 344/656] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:06 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:07.075739 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:07.076425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:07.097627 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.098229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.099066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.099511 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.235726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:07.237095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:07.244956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.245746 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.246812 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.247463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.302057 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:07.310122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4d9fea48-eb62-42c9-abd1-436e2bb0d54e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.238712 Feb 12 04:23:07.310878 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 313/657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:07 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:07.411697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:07.420013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0adec03f-3261-4b15-83a8-0f2e35b5f6a2 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.192127 Feb 12 04:23:07.420586 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 345/658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:07 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:07.672302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:07.674716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:07.679144 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.679582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.680348 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:07.680943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:07.843519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:07.851191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b237134e-7a88-446a-a087-f548e5bf2b4c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1758 microversion: 2.1 time: 0.182708 Feb 12 04:23:07.851754 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 314/659] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:07 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:08.327777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:08.328448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:08.335117 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:08.335619 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:08.336408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:08.336835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:08.438728 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:08.439217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:08.449666 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:08.450807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:08.451594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:08.452019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:08.542324 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:08.551212 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4a3ec426-3b9a-4420-9a19-b0b0ba2cc92d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.227018 Feb 12 04:23:08.562484 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 346/660] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:08 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:08.629136 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:08.639054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0ad2fce0-8f56-4064-9569-e7b9f4969ca0 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.205320 Feb 12 04:23:08.645016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 315/661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:08 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:09.299758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-ad997351-7b4b-4aa7-8270-f673bbcfe29c req-3715e50f-f924-490d-8170-38aeb05d0593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef7cee0-0173-4a04-856c-7bcd7430449d", "name": "network-vif-plugged", "status": "completed", "tag": "ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:09.301627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:09.301627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:23:09.313061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ad997351-7b4b-4aa7-8270-f673bbcfe29c req-3715e50f-f924-490d-8170-38aeb05d0593 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:09.313560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-ad997351-7b4b-4aa7-8270-f673bbcfe29c req-3715e50f-f924-490d-8170-38aeb05d0593 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:09.331842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-ad997351-7b4b-4aa7-8270-f673bbcfe29c req-3715e50f-f924-490d-8170-38aeb05d0593 service nova] Creating event network-vif-plugged:ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa for instance 5ef7cee0-0173-4a04-856c-7bcd7430449d on hv-cinder-82869 Feb 12 04:23:09.336655 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-ad997351-7b4b-4aa7-8270-f673bbcfe29c req-3715e50f-f924-490d-8170-38aeb05d0593 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040655 Feb 12 04:23:09.337271 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 347/662] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:23:09.570604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:09.572181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:09.579662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:09.580382 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:09.581825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:09.582342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:09.658777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:09.659466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:09.668232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:09.669679 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:09.677868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:09.677868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:09.852279 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:09.861834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-14cd6f84-279c-4e1a-bb75-d2d75d1fcd19 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.295632 Feb 12 04:23:09.866363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 316/663] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:09 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:09.899581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:09.907853 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0fa90b27-3fe8-4c91-ba0a-53b9ec59020e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.254588 Feb 12 04:23:09.908414 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 348/664] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:09 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:10.879233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:10.879860 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:10.886729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:10.887180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:10.887954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:10.888388 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:10.923977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:10.924613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:10.931286 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:10.931728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:10.932512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:10.932941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:11.078926 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:11.087792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8c843703-0c32-486b-a06d-d4bcfb648aae tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.211622 Feb 12 04:23:11.088484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 317/665] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:10 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:11.108536 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:11.117161 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ff35b549-2116-43c0-bd61-c47e8ef1f668 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1318 microversion: 2.1 time: 0.196829 Feb 12 04:23:11.117768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 349/666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:10 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:12.104725 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:12.105360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:12.111902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.116369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.116369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.116369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.132718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:12.133355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:12.139866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.144995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.144995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.144995 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.589358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:12.599782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f258807d-671e-476c-9d60-724d667a105b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.499456 Feb 12 04:23:12.602926 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 318/667] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:12 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:12.610191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:12.615698 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:12.620944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:12.630227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-14ad4ad7-128f-4dda-8e36-c95da80af03e tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1507 microversion: 2.1 time: 0.500990 Feb 12 04:23:12.635948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 350/668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:12 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:12.637850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.638474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.639257 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.639682 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.652051 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b446a82-8084-4185-8714-40957a95e140", "device": "/dev/sdb"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:12.653929 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:12.660213 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.660665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.661482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.661922 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.705544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5ca76185-3cde-4bd4-b73f-40a8acbac7a0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments/b7c78a00-1af6-4a49-9091-e290f6cb45f4" status: 200 len: 194 microversion: 2.20 time: 0.101396 Feb 12 04:23:12.708015 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 319/669] 10.222.0.31 () {60 vars in 1453 bytes} [Sat Feb 12 04:23:12 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments/b7c78a00-1af6-4a49-9091-e290f6cb45f4 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:23:12.796054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:12.796817 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:12.804581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.806574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.807561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:12.808166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:12.916598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lazy-loading 'services' on Instance uuid 5d27a38f-f79b-4a12-8dd1-e520acda4662 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:23:13.247888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5893d346-06de-43ab-9255-6ab6865d4c6e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments/b7c78a00-1af6-4a49-9091-e290f6cb45f4" status: 202 len: 0 microversion: 2.20 time: 0.456732 Feb 12 04:23:13.252567 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 320/670] 10.222.0.31 () {60 vars in 1456 bytes} [Sat Feb 12 04:23:12 2022] DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments/b7c78a00-1af6-4a49-9091-e290f6cb45f4 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 12 04:23:13.258010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:13.259466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:13.265716 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:13.266167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:13.266951 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:13.267384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:13.303459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9a6bd05b-c759-498b-ad46-4d57965b415e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049546 Feb 12 04:23:13.304133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 321/671] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 04:23:13 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:23:13.619526 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:13.622156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:13.630047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:13.630700 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:13.631755 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:13.632114 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:13.766127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e3027799-b45b-490b-9c50-4971803d5424 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "POST /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.119295 Feb 12 04:23:13.767597 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 351/672] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:23:12 2022] POST /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d/os-volume_attachments => generated 194 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:23:13.819516 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:13.834702 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0cdea48a-b5ae-457b-9616-b71de13d1bb0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.216819 Feb 12 04:23:13.836505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 322/673] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:13 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:14.315772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:14.317061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:14.331218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:14.331218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:14.331218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:14.333615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:14.384001 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1b635f6d-a3d9-46af-a5cb-32b6c579fb98 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073276 Feb 12 04:23:14.384585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 352/674] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 04:23:14 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 04:23:14.853197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:14.853842 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:14.861087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:14.861603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:14.862804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:14.863442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:15.106943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:15.118983 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ca6f8bb1-f13a-49f7-8aeb-6ec5d8a49695 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1675 microversion: 2.1 time: 0.268965 Feb 12 04:23:15.120627 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 323/675] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:14 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1675 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:15.401690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:15.403375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:15.412023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:15.412802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:15.413720 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:15.414342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:15.454320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2f2746a8-ca1d-464a-9819-7821df477e7d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061601 Feb 12 04:23:15.455150 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 353/676] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 04:23:15 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:15.517662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:15.518154 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:15.524349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:15.524798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:15.525604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:15.526036 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:15.554383 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:23:16.014922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3324182c-4bd9-462f-9d2d-9c632b26167e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 204 len: 0 microversion: 2.20 time: 0.500992 Feb 12 04:23:16.023140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 324/677] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 04:23:15 2022] DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:23:16.036620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:16.050107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:16.064447 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.065801 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.066842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.067492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.136887 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:16.138148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:16.147494 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.150704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.151767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.155635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.326352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:16.345618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:16.347645 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:16.349446 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-315cd35e-a299-484c-97d4-a710fbcfe438 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.321789 Feb 12 04:23:16.350460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 354/678] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:16 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:16.407070 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:16.415793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-605bdf2d-c32a-4c23-a555-c3499e3f064c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1652 microversion: 2.1 time: 0.282940 Feb 12 04:23:16.417004 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 325/679] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:16 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1652 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:16.436826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-15c210c2-7486-4784-8423-3e4ea22d87fe tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:16.443215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15c210c2-7486-4784-8423-3e4ea22d87fe tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.443665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15c210c2-7486-4784-8423-3e4ea22d87fe tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.468482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-15c210c2-7486-4784-8423-3e4ea22d87fe tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Going to try to start instance {{(pid=116751) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 04:23:16.675871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-15c210c2-7486-4784-8423-3e4ea22d87fe tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.242337 Feb 12 04:23:16.676912 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 355/680] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:23:16 2022] POST /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:23:16.685167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:16.685894 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:16.693118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.694212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.695282 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:16.695895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:16.882311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:16.891690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8a5987aa-e69b-43c7-b585-908e0b43d08a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1661 microversion: 2.1 time: 0.210486 Feb 12 04:23:16.892829 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 326/681] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:16 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1661 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:17.378105 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:17.379609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:17.391316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:17.391316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:17.391316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:17.391316 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:17.636677 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:17.646886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:17.648917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:17.651332 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-49b971f3-622b-4698-9dbf-d23504983e3f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1724 microversion: 2.20 time: 0.286269 Feb 12 04:23:17.665710 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 356/682] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:17 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:17.909486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:17.910668 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:17.918314 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:17.923574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:17.923574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:17.923574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:18.077350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:18.092226 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-55dc44ba-521f-4b69-b364-12af5cfb6d52 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1661 microversion: 2.1 time: 0.181205 Feb 12 04:23:18.094442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 327/683] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:17 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1661 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:18.671741 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:18.672646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:18.680063 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:18.680678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:18.681748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:18.682379 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:18.797194 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:18.814666 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:18.818154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:18.825056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6c1901ce-1335-43ef-851c-1f42b7152da0 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1657 microversion: 2.20 time: 0.157158 Feb 12 04:23:18.826169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 357/684] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:18 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:19.112331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:19.112769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:19.125999 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.126466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.127283 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.129478 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.291668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-61521ab2-8a7e-494d-95cf-e22179f531c7 req-af3f07a6-c0bf-4e04-8338-635e483a2abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27a38f-f79b-4a12-8dd1-e520acda4662", "name": "network-vif-deleted", "tag": "7f295ad4-24a6-4a7e-b33a-2a928cd09e95"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:19.294939 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:19.294939 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:23:19.305959 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-61521ab2-8a7e-494d-95cf-e22179f531c7 req-af3f07a6-c0bf-4e04-8338-635e483a2abd service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.307434 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-61521ab2-8a7e-494d-95cf-e22179f531c7 req-af3f07a6-c0bf-4e04-8338-635e483a2abd service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.334255 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-61521ab2-8a7e-494d-95cf-e22179f531c7 req-af3f07a6-c0bf-4e04-8338-635e483a2abd service nova] Creating event network-vif-deleted:7f295ad4-24a6-4a7e-b33a-2a928cd09e95 for instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 on hv-cinder-82869 Feb 12 04:23:19.343581 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-61521ab2-8a7e-494d-95cf-e22179f531c7 req-af3f07a6-c0bf-4e04-8338-635e483a2abd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055940 Feb 12 04:23:19.348442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 358/685] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:23:19.475573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:19.484786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f2734415-5f02-4594-bb7a-a0cda8e4040f tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1665 microversion: 2.1 time: 0.375222 Feb 12 04:23:19.486906 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 328/686] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:19 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1665 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:19.844554 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:19.845825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:19.853085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.853753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.855056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.855056 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.890346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:19.890759 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:19.891648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lazy-loading 'fault' on Instance uuid 5d27a38f-f79b-4a12-8dd1-e520acda4662 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:23:19.951512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:19.964552 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:19.966595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:19.968371 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2b4b39d9-09dd-45e6-811d-68b5e4f5c037 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 200 len: 1372 microversion: 2.20 time: 0.128132 Feb 12 04:23:19.969086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 359/687] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:19 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:20.987656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:20.988342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:21.001230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:21.002374 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:21.004939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:21.005692 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:21.034872 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. Feb 12 04:23:21.038420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:23:21.046355 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e025a785-f1ee-4c2f-bd82-0b0a5d26001f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 404 len: 111 microversion: 2.20 time: 0.057376 Feb 12 04:23:21.050559 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 329/688] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:20 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 04:23:21.066076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6aaa7ae5-4783-42ff-a3d5-84c07da506cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '.version_select at 0x7f8e68d16790>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:21.247853 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6aaa7ae5-4783-42ff-a3d5-84c07da506cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306831503" status: 204 len: 0 microversion: 2.20 time: 0.192228 Feb 12 04:23:21.256397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 360/689] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306831503 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:23:23.115724 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: .version_select at 0x7f8e6839a550>, body: {"keypair": {"name": "tempest-keypair-163355894"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:23.156005 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:23.183618 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:23.238408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [bde4b0e3-86cf-401e-8958-c0f8fe233221] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 04:23:24.250122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [bde4b0e3-86cf-401e-8958-c0f8fe233221] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53882. Feb 12 04:23:24.872416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:24.879591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:24.918706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-81679cf0-4772-440b-a56a-c5e120ef6b3b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.807460 Feb 12 04:23:24.927216 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 330/690] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 04:23:23 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1817 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:23:27.635640 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Action: 'create', calling method: .version_select at 0x7f8e68d0bee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1487177663"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:27.685320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for project 9562939d04a04f868c738263f2375b8e. Resources: {'key_pairs'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:27.694202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for user 489271f8dc5a432792bea8521abf5eb8 and project 9562939d04a04f868c738263f2375b8e. Resources: {'key_pairs'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:28.180005 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for project 9562939d04a04f868c738263f2375b8e. Resources: {'key_pairs'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:28.193168 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for user 489271f8dc5a432792bea8521abf5eb8 and project 9562939d04a04f868c738263f2375b8e. Resources: {'key_pairs'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:28.199029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-da6c56da-aad3-4f7b-9aa2-ceffad3d8d73 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.793030 Feb 12 04:23:28.200227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 361/691] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 04:23:27 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:28.522850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-554953035", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a470119b-e597-4f7c-b914-bdedfeebd027"}], "security_groups": [{"name": "tempest-securitygroup--1774801050"}], "key_name": "tempest-keypair-163355894", "user_data": "}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:28.652225 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] validate_networks() for [('a470119b-e597-4f7c-b914-bdedfeebd027', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:23:29.140104 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:23:29.140546 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:23:29.141007 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:23:29.141451 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:23:29.146879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:23:29.162799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:29.163272 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:29.164253 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:29.164732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:29.183143 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:29.189226 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Getting quotas for user 86560704b2374f75bc32b19475b63462 and project f5a7d98ea94e4547983dbffcb2b614bc. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:29.213191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:23:29.220266 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:23:29.366483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a374df3b-ddc9-40e2-be24-fc518c710bdf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.852120 Feb 12 04:23:29.367123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 331/692] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 04:23:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 04:23:29.379224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:29.380110 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:29.455965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:29.475517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:29.479510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:29.484516 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c34ed6c9-4d58-4f98-a3a6-5cec8881da35 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1280 microversion: 2.20 time: 0.109167 Feb 12 04:23:29.487123 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 362/693] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:29 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:30.504981 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:30.505814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:30.511822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:30.512356 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:30.513123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:30.513807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:30.574125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:30.586538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:30.588204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:30.589345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e479f81e-16ca-4a32-b08b-be445a5adafb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1284 microversion: 2.20 time: 0.088611 Feb 12 04:23:30.589910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 332/694] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:30 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:31.608481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:31.609091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:31.616342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:31.616793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:31.617604 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:31.618072 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:31.693892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:31.703838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:31.705388 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:31.706730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-df4c431e-2930-46e2-b872-ebcf38d0e8e5 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1276 microversion: 2.20 time: 0.102352 Feb 12 04:23:31.707472 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 363/695] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:31 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:32.725932 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:32.726470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:32.732991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:32.733474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:32.734236 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:32.734694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:32.795827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:32.803438 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:32.804916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:32.806020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-66e4cfa4-ef26-4be3-b1a7-e99cb9c5e9cf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1332 microversion: 2.20 time: 0.083883 Feb 12 04:23:32.806570 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 333/696] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:32 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1332 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:33.823437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:33.824047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:33.830404 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:33.830862 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:33.831644 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:33.832084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:33.897590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:33.905270 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:33.906814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:33.907940 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9e5f251b-ce7a-479b-bba3-75ee6fe83c4c tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1332 microversion: 2.20 time: 0.088861 Feb 12 04:23:33.908498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 364/697] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:33 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:34.924832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:34.926055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:34.932854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:34.933609 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:34.934422 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:34.935035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:34.999984 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:35.009658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:35.011195 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:35.012358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9a0c63af-c93d-4919-86c3-2a0d0a6c3db9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1340 microversion: 2.20 time: 0.091211 Feb 12 04:23:35.013873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 334/698] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:34 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:36.031778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:36.033148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:36.041401 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:36.041889 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:36.042864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:36.043301 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:36.183576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:36.195068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:36.196844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:36.198009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-afdbde2a-683d-406f-9762-cb4c218708f7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.170886 Feb 12 04:23:36.198783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 365/699] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:36 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:23:36.783794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-11611545-15bb-4c74-969d-6a605c1dee14 req-5f1c0ebc-600c-4f4f-a76e-1439277dbe52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:36.785519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:36.785519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:23:36.793982 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-11611545-15bb-4c74-969d-6a605c1dee14 req-5f1c0ebc-600c-4f4f-a76e-1439277dbe52 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:36.794423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-11611545-15bb-4c74-969d-6a605c1dee14 req-5f1c0ebc-600c-4f4f-a76e-1439277dbe52 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:36.811217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-11611545-15bb-4c74-969d-6a605c1dee14 req-5f1c0ebc-600c-4f4f-a76e-1439277dbe52 service nova] Creating event network-changed:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:23:36.815084 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-11611545-15bb-4c74-969d-6a605c1dee14 req-5f1c0ebc-600c-4f4f-a76e-1439277dbe52 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035506 Feb 12 04:23:36.815701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 335/700] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:23:37.218842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:37.219358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:37.225951 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:37.226400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:37.227211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:37.227639 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:37.358181 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:37.365944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:37.367447 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:37.368595 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-117a21ce-79fb-4720-a431-1c5440bd4e3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.153608 Feb 12 04:23:37.369308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 366/701] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:37 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:38.386700 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:38.387392 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:38.393875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:38.394331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:38.395095 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:38.395527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:38.528184 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:38.536119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:38.537662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:38.538757 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e698058f-c8de-4ce5-b110-342b8894316d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.156210 Feb 12 04:23:38.539313 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 336/702] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:38 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:39.559850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:39.561058 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:39.568136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:39.568592 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:39.569432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:39.569874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:39.949641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:39.957384 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:39.958865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:39.959955 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9cbfa32a-6f40-4392-9948-c6205360f026 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.403934 Feb 12 04:23:39.960504 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 367/703] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:39 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:23:40.676710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:40.677207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:40.683812 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:40.684310 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:40.685092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:40.685592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:40.765269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lazy-loading 'services' on Instance uuid 5ef7cee0-0173-4a04-856c-7bcd7430449d {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:23:40.978998 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:40.979686 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:40.980599 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ffea08b0-bb1f-4009-b1a1-4c1251979616 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d/os-volume_attachments/5b446a82-8084-4185-8714-40957a95e140" status: 202 len: 0 microversion: 2.1 time: 0.307416 Feb 12 04:23:40.984670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 337/704] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:23:40 2022] DELETE /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d/os-volume_attachments/5b446a82-8084-4185-8714-40957a95e140 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:23:40.988048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:40.988583 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:40.989515 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:40.990024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:41.209139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:41.216994 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:41.218588 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:41.219688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6a331f2e-3692-4e12-a45e-12642932378e tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.245397 Feb 12 04:23:41.220242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 368/705] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:40 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:23:42.238889 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:42.239730 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:42.247651 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:42.253631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:42.253631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:42.253631 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:42.394165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:42.403594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:42.407400 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:42.408541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-20244f6c-88d0-436b-9c8b-2084e391a999 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.174319 Feb 12 04:23:42.409106 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 338/706] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:42 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:43.170806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:43.171315 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:43.177500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.178178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.178828 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.179260 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.215445 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:23:43.426902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:43.428857 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:43.437601 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.439483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.440502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.440947 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.552438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e4fff8b4-5da5-42fb-be98-ae1f551ac804 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 204 len: 0 microversion: 2.1 time: 0.384815 Feb 12 04:23:43.554199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 369/707] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:23:43 2022] DELETE /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:23:43.563611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:43.564753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:43.574913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.576202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.577565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:43.578305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:43.597043 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:43.611863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:43.611863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:43.611863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ca1a0d75-fc4b-4325-9fa2-f3c782fb7928 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.187879 Feb 12 04:23:43.612218 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 339/708] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:43 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:43.730196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:43.737962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e9e6031b-9541-4423-83de-5faadc730073 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1513 microversion: 2.1 time: 0.179163 Feb 12 04:23:43.738569 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 370/709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:43 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:44.629129 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:44.629778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:44.636543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:44.636990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:44.637790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:44.638217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:44.755875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:44.756540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:44.764665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:44.766090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:44.766090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:44.766453 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:44.779031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:44.787550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:44.789935 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:44.790651 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bb3ee846-0d14-4e5c-838e-34c639737ddb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.165264 Feb 12 04:23:44.791560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 340/710] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:44 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:44.929027 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:44.936355 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4da8b128-ce76-435e-aaaf-f8c2f604b6b1 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1513 microversion: 2.1 time: 0.184265 Feb 12 04:23:44.936917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 371/711] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:44 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:45.809241 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:45.809865 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:45.816108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:45.816544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:45.817326 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:45.817755 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:45.956946 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:45.957592 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:45.966573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:45.968159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:45.968783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:45.969852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:45.970283 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:45.974625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:45.976128 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:45.977229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-32a39039-51bb-4687-894e-ccf23fc1b9ab tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.172158 Feb 12 04:23:45.977806 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 341/712] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:45 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:46.102552 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:46.110442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2027926f-e460-41be-85fb-5b8c1432c535 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1513 microversion: 2.1 time: 0.157101 Feb 12 04:23:46.110997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 372/713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:45 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:46.558289 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-9d5cceb1-7588-4dcc-a933-64e7ee03bb31 req-a7ada80f-6e46-4d1d-8b2d-847e69e4d26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "name": "network-vif-plugged", "status": "completed", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:46.561683 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:46.561683 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:23:46.567476 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-9d5cceb1-7588-4dcc-a933-64e7ee03bb31 req-a7ada80f-6e46-4d1d-8b2d-847e69e4d26f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:46.567996 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-9d5cceb1-7588-4dcc-a933-64e7ee03bb31 req-a7ada80f-6e46-4d1d-8b2d-847e69e4d26f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:46.579956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-9d5cceb1-7588-4dcc-a933-64e7ee03bb31 req-a7ada80f-6e46-4d1d-8b2d-847e69e4d26f service nova] Creating event network-vif-plugged:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:23:46.585014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-9d5cceb1-7588-4dcc-a933-64e7ee03bb31 req-a7ada80f-6e46-4d1d-8b2d-847e69e4d26f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030356 Feb 12 04:23:46.585632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 342/714] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:23:46.997661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:46.998264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:47.004017 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:47.004467 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:47.005233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:47.005693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:47.128853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:47.129572 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:47.136284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:47.136727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:47.137523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:47.137956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:47.139208 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:47.146998 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:47.148489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:47.149602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ca628905-0237-4648-8668-1b8de56cdb17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.158432 Feb 12 04:23:47.150151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 373/715] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:46 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:47.267231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:47.274398 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b58b1e44-3bb1-4a0b-a33d-522b80da2d58 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1513 microversion: 2.1 time: 0.150193 Feb 12 04:23:47.274951 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 343/716] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:47 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:23:48.168615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:48.169221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:48.175562 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:48.176009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:48.176779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:48.177211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:48.294170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:48.294788 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:48.301717 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:48.302681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:48.303667 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:48.304364 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:48.328383 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:48.336864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:48.339257 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:48.340711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-21386788-b05f-481f-94eb-7f3c20458880 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.176581 Feb 12 04:23:48.351735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 374/717] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:48 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:48.506490 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:48.514287 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fcbe836e-a2ff-4ecb-95a6-e8b4a0785c74 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1513 microversion: 2.1 time: 0.225281 Feb 12 04:23:48.514791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 344/718] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:48 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:48.712062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-29d968b3-96b6-4fd5-a395-35b9bf9d884d req-4d5b5604-1a7a-468b-9854-a36b7d93e74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef7cee0-0173-4a04-856c-7bcd7430449d", "name": "network-vif-deleted", "tag": "ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:48.714404 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:48.714404 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:23:48.721073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-29d968b3-96b6-4fd5-a395-35b9bf9d884d req-4d5b5604-1a7a-468b-9854-a36b7d93e74e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:48.721552 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-29d968b3-96b6-4fd5-a395-35b9bf9d884d req-4d5b5604-1a7a-468b-9854-a36b7d93e74e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:48.732058 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-29d968b3-96b6-4fd5-a395-35b9bf9d884d req-4d5b5604-1a7a-468b-9854-a36b7d93e74e service nova] Creating event network-vif-deleted:ab88f4ec-b2f6-4fee-8d65-ccbe29ed9eaa for instance 5ef7cee0-0173-4a04-856c-7bcd7430449d on hv-cinder-82869 Feb 12 04:23:48.738227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-29d968b3-96b6-4fd5-a395-35b9bf9d884d req-4d5b5604-1a7a-468b-9854-a36b7d93e74e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029895 Feb 12 04:23:48.738943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 375/719] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:23:49.359102 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:49.359709 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:49.366015 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:49.366461 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:49.367238 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:49.367674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:49.506035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:49.513632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:49.515124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:49.516208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6c0dba57-d383-494f-8ee7-bc975614bde1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1406 microversion: 2.20 time: 0.161086 Feb 12 04:23:49.516770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 345/720] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:49 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:49.539895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:49.540641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:49.561825 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:49.562585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:49.563855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:49.564770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:49.596851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:49.597322 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:49.597790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lazy-loading 'fault' on Instance uuid 5ef7cee0-0173-4a04-856c-7bcd7430449d {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:23:49.638671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c229e1d0c4da7bc08c068d087a6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c9d14816d4e4f7c9fdd17604fe92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:49.646245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0a547e22-e091-40c4-afdf-59c9e94289f8 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 200 len: 1308 microversion: 2.1 time: 0.111059 Feb 12 04:23:49.646813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 376/721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:49 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:50.534323 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:50.535179 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:50.541807 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.542284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.543071 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.543506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.663796 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:50.664435 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] [instance: 5ef7cee0-0173-4a04-856c-7bcd7430449d] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:50.672471 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.673732 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.674019 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.674433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.675910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:50.684622 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:50.686227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:50.687384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-377ee9bc-1f97-4b2e-bcf0-c3c9c69d8602 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1597 microversion: 2.20 time: 0.157421 Feb 12 04:23:50.687949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 346/722] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:23:50 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:23:50.688645 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] HTTP exception thrown: Instance 5ef7cee0-0173-4a04-856c-7bcd7430449d could not be found. Feb 12 04:23:50.689403 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] Returning 404 to user: Instance 5ef7cee0-0173-4a04-856c-7bcd7430449d could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:23:50.690218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a6396a10-8a51-4b02-964c-710d0e55a3a7 tempest-VolumesSnapshotTestJSON-1666007685 tempest-VolumesSnapshotTestJSON-1666007685-project] 10.222.0.31 "GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d" status: 404 len: 111 microversion: 2.1 time: 0.030205 Feb 12 04:23:50.690748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 377/723] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:50 2022] GET /compute/v2.1/servers/5ef7cee0-0173-4a04-856c-7bcd7430449d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:23:50.704743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:50.709452 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:50.711521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.711968 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.712834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:50.713305 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:50.803358 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5804b718-f10f-4db6-b806-d2c3fb2952f9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102646 Feb 12 04:23:50.804093 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 347/724] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 04:23:50 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:23:51.906391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:51.908842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:51.913269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-0297d7b1-cd6b-4997-b619-cfa60c9f1dc7 req-a44c28d0-8461-48ed-b626-47ffaafedddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:51.914024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:51.914715 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:51.915175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:51.915175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:23:51.915669 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:51.916373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:51.922306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0297d7b1-cd6b-4997-b619-cfa60c9f1dc7 req-a44c28d0-8461-48ed-b626-47ffaafedddc service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:51.928379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-0297d7b1-cd6b-4997-b619-cfa60c9f1dc7 req-a44c28d0-8461-48ed-b626-47ffaafedddc service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:51.934503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-0297d7b1-cd6b-4997-b619-cfa60c9f1dc7 req-a44c28d0-8461-48ed-b626-47ffaafedddc service nova] Creating event network-changed:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:23:51.939484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-0297d7b1-cd6b-4997-b619-cfa60c9f1dc7 req-a44c28d0-8461-48ed-b626-47ffaafedddc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033141 Feb 12 04:23:51.940077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 348/725] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:23:51.960312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b5856060-9960-4eb7-b2ac-33768724c764 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/ips" status: 200 len: 111 microversion: 2.20 time: 0.058383 Feb 12 04:23:51.960894 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 378/726] 10.222.0.31 () {60 vars in 1288 bytes} [Sat Feb 12 04:23:51 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/ips => generated 111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:23:53.392687 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2127751775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1487177663", "security_groups": [{"name": "tempest-secgroup-smoke-1222344398"}], "networks": [{"uuid": "cebed9f7-140d-47a7-aec8-23c08b8b80f3"}], "block_device_mapping_v2": [{"uuid": "eb3574cb-0052-46d6-ab37-78114db79a6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:53.615874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] validate_networks() for [('cebed9f7-140d-47a7-aec8-23c08b8b80f3', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:23:53.992502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:23:53.992922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:23:53.993428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:23:53.993833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:23:53.994239 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:23:54.002884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:54.003329 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:54.004163 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:54.004596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:54.020664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for project 9562939d04a04f868c738263f2375b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:23:54.024426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Getting quotas for user 489271f8dc5a432792bea8521abf5eb8 and project 9562939d04a04f868c738263f2375b8e. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:23:54.091597 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:23:54.094164 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb3574cb-0052-46d6-ab37-78114db79a6c',volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:23:54.530842 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f6dab705-e35b-4683-b7c6-8709214e836e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.142466 Feb 12 04:23:54.531828 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 349/727] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:23:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:23:54.541850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4376693f-5b54-4912-9b5c-02980bb65c05 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:54.542591 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4376693f-5b54-4912-9b5c-02980bb65c05 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:54.733630 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4376693f-5b54-4912-9b5c-02980bb65c05 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:54.740474 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4376693f-5b54-4912-9b5c-02980bb65c05 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1089 microversion: 2.1 time: 0.202625 Feb 12 04:23:54.741232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 379/728] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:54 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1089 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:55.760616 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:55.761230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:55.768224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:55.768746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:55.769594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:55.770031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:55.829170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:55.836461 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-541f332b-f835-4014-adb0-c1f118d4b41f tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1139 microversion: 2.1 time: 0.082410 Feb 12 04:23:55.836956 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 350/729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:55 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:56.796649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:23:56.797212 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:23:56.853115 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:56.853778 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:56.861435 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:56.861886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:56.862661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:56.863097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:56.922187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:56.929751 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-74e7b945-630c-4d2c-b5b8-5d39de4613ef tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1187 microversion: 2.1 time: 0.079920 Feb 12 04:23:56.930272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 380/730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:56 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1187 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:57.959390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:57.959390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:57.965294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:57.966464 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:57.966566 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:57.966951 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:58.026380 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:58.034213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-79f1c109-8707-40dd-91c3-eb862485fe55 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1205 microversion: 2.1 time: 0.079278 Feb 12 04:23:58.034990 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 351/731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:57 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1205 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:23:59.052203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:23:59.052820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:23:59.059664 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:59.060113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:59.060931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:59.061422 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:59.164587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-67c6b639-5c13-4822-87b0-95ab777a42f9 req-f8c64032-bbd6-4e18-a5a1-054bfe4f1471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:23:59.166196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:23:59.166196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:23:59.184175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-67c6b639-5c13-4822-87b0-95ab777a42f9 req-f8c64032-bbd6-4e18-a5a1-054bfe4f1471 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:23:59.185072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-67c6b639-5c13-4822-87b0-95ab777a42f9 req-f8c64032-bbd6-4e18-a5a1-054bfe4f1471 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:23:59.204453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-67c6b639-5c13-4822-87b0-95ab777a42f9 req-f8c64032-bbd6-4e18-a5a1-054bfe4f1471 service nova] Creating event network-changed:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:23:59.213395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-67c6b639-5c13-4822-87b0-95ab777a42f9 req-f8c64032-bbd6-4e18-a5a1-054bfe4f1471 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051248 Feb 12 04:23:59.214057 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 352/732] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:23:59.259314 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:23:59.268808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-bb38fd9a-94b1-4922-ba26-28a6494f1fbc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1273 microversion: 2.1 time: 0.220217 Feb 12 04:23:59.280721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 381/733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:23:59 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:00.293115 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:00.293851 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:00.299876 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:00.300304 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:00.301075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:00.301534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:00.491210 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:00.499880 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a5ec462d-2de4-40fa-ae69-bae5561d8957 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.213818 Feb 12 04:24:00.500742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 353/734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:00 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:01.515852 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:01.516464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:01.522787 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:01.523226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:01.524000 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:01.524438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:01.659998 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:01.667303 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0c93104a-71a8-45b8-a12e-2452b98c34d4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.155167 Feb 12 04:24:01.668498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 382/735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:01 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:02.683846 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:02.684382 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:02.690783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:02.691228 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:02.692053 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:02.692483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:02.829396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:02.836628 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6e2bbaa3-f947-4237-b9e7-ae36459505e4 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.156690 Feb 12 04:24:02.837200 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 354/736] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:02 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:03.852521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:03.853159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:03.859938 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:03.860390 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:03.861165 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:03.861630 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:03.993678 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:04.000986 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6876b211-a1ce-4671-8a68-f617ed371505 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.152083 Feb 12 04:24:04.002544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 383/737] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:03 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:05.017248 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:05.018580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:05.025088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:05.025566 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:05.026346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:05.026780 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:05.159279 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:05.166521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-787373a9-2f59-452e-b5f1-fd8e6489760b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.152919 Feb 12 04:24:05.167069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 355/738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:05 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:06.182663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:06.183248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:06.190126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:06.190577 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:06.191339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:06.191763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:06.333093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:06.341489 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0866d7ed-5996-4875-a4e2-09854144ec5b tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.162431 Feb 12 04:24:06.342154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 384/739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:06 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:07.359232 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:07.359925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:07.366612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:07.372009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:07.372009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:07.372009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:07.504741 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:07.512077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7e02f51a-030a-4ace-a2c8-c7628c53fbe6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.157590 Feb 12 04:24:07.512642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 356/740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:07 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:08.528931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:08.529626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:08.536647 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:08.537092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:08.538022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:08.538456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:08.681239 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:08.685793 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8e42a683-42a3-451a-8649-5737cf12b2d9 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.160595 Feb 12 04:24:08.686557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 385/741] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:08 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:09.706733 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:09.712054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:09.718943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:09.719320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:09.720045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:09.720483 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:09.854899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:09.864769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-21bd4471-7b11-4e97-b833-b003bf295853 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.161679 Feb 12 04:24:09.865620 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 357/742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:09 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:10.415327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-89732096-c594-4233-8c75-52776d638ea5 req-04b6dcfe-87d0-494d-af48-b4a6a1bfa7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "name": "network-vif-plugged", "status": "completed", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:10.417068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:10.417068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:10.424534 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-89732096-c594-4233-8c75-52776d638ea5 req-04b6dcfe-87d0-494d-af48-b4a6a1bfa7c8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:10.424980 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-89732096-c594-4233-8c75-52776d638ea5 req-04b6dcfe-87d0-494d-af48-b4a6a1bfa7c8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:10.435620 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-89732096-c594-4233-8c75-52776d638ea5 req-04b6dcfe-87d0-494d-af48-b4a6a1bfa7c8 service nova] Creating event network-vif-plugged:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:24:10.440979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-89732096-c594-4233-8c75-52776d638ea5 req-04b6dcfe-87d0-494d-af48-b4a6a1bfa7c8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029909 Feb 12 04:24:10.445146 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 386/743] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:10.882296 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:10.883171 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:10.891092 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:10.891884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:10.893151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:10.893822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:11.073155 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:11.081414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1b340360-0092-4e2e-b4f7-acc3e6f9a6bb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.202777 Feb 12 04:24:11.082160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 358/744] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:10 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:11.243334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-139681348"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:11.243334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:11.248360 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:11.248820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:11.249690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:11.250127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:11.386018 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.network.security_group_api [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Removing security group 7449ad82-0140-4eb9-ba7f-a0cbfb6256eb from port dd02aa9e-3381-43c8-b1fd-9ad35f7198ea Feb 12 04:24:12.097963 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:12.098584 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:12.104789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:12.105240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:12.106055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:12.106491 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:12.221540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-92d3fc52-ae66-4996-8c08-df9547fd976c tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action" status: 202 len: 0 microversion: 2.1 time: 0.984610 Feb 12 04:24:12.224560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 387/745] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:24:11 2022] POST /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:24:12.232313 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-c56cb287-c91f-4237-8354-0f136272b6ee req-57772316-fee6-4b2b-ae2d-06395bf51fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:12.235413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:12.235413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:12.272226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-c56cb287-c91f-4237-8354-0f136272b6ee req-57772316-fee6-4b2b-ae2d-06395bf51fc9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:12.272226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-c56cb287-c91f-4237-8354-0f136272b6ee req-57772316-fee6-4b2b-ae2d-06395bf51fc9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:12.307379 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-c56cb287-c91f-4237-8354-0f136272b6ee req-57772316-fee6-4b2b-ae2d-06395bf51fc9 service nova] Creating event network-changed:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:24:12.322878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-c56cb287-c91f-4237-8354-0f136272b6ee req-57772316-fee6-4b2b-ae2d-06395bf51fc9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096005 Feb 12 04:24:12.323779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 388/746] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:12.382384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:12.390836 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e23abc7f-b086-47c4-8662-81adfc483f6e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1261 microversion: 2.1 time: 0.295883 Feb 12 04:24:12.393611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 359/747] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:12 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1261 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:13.410790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:13.411479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:13.421152 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:13.421846 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:13.423066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:13.423513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:13.710667 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:13.719781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-24c806c7-8674-41ee-a0d6-8748f7f97081 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1444 microversion: 2.1 time: 0.314139 Feb 12 04:24:13.732062 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 389/748] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:13 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1444 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:13.740107 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:13.740712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:13.749883 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:13.750667 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:13.752528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:13.753317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.013233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:14.021056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d7d64270-0649-412d-945b-b1ae7ff70b9a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1444 microversion: 2.1 time: 0.287339 Feb 12 04:24:14.021669 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 360/749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:13 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1444 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:14.346724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:14.349075 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:14.349194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-939ad231-180c-4229-9bc0-327eaabf33a7 req-e08869d1-9cd0-4d5d-b79a-10c42c3d45b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:14.350703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:14.350703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:14.356633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:14.357083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.358148 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:14.358683 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-939ad231-180c-4229-9bc0-327eaabf33a7 req-e08869d1-9cd0-4d5d-b79a-10c42c3d45b5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:14.359386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-939ad231-180c-4229-9bc0-327eaabf33a7 req-e08869d1-9cd0-4d5d-b79a-10c42c3d45b5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.361878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.371982 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-939ad231-180c-4229-9bc0-327eaabf33a7 req-e08869d1-9cd0-4d5d-b79a-10c42c3d45b5 service nova] Creating event network-changed:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:24:14.380031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-939ad231-180c-4229-9bc0-327eaabf33a7 req-e08869d1-9cd0-4d5d-b79a-10c42c3d45b5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Feb 12 04:24:14.381010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 361/750] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:14.485487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lazy-loading 'services' on Instance uuid b31a136c-eb25-47f3-87b9-7cfde7123fb4 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:24:14.774462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-019e0b4c-5329-4b0f-8bf2-7e648bfc0776 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments/1c231134-7583-4349-8116-c50bcd2b3a45" status: 202 len: 0 microversion: 2.1 time: 0.430076 Feb 12 04:24:14.782091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 390/751] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:24:14 2022] DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments/1c231134-7583-4349-8116-c50bcd2b3a45 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:24:14.792201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:14.793838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:14.812020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:14.814081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.815708 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:14.818338 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:14.864560 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-369fc8be-e347-429a-be57-81476294d595 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077748 Feb 12 04:24:14.868484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 362/752] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:24:14 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:15.881161 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:15.881161 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:15.886243 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:15.886768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:15.887844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:15.888530 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:15.927771 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ae36ab46-358b-4723-a46a-807323eb5b31 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055341 Feb 12 04:24:15.928726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 391/753] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:24:15 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:16.942614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:16.943905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:16.950515 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:16.950964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:16.952002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:16.952440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:16.986240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-070fa30d-25b0-4a88-bfa7-0b5514909329 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047255 Feb 12 04:24:16.987203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 392/754] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:24:16 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:24:16.996223 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:16.996788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:17.003629 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:17.004108 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:17.004969 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:17.005333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:17.011619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-8c3a9b8d-f5b0-403a-8387-56427dc79f56 req-8f497d04-66b1-4176-9d3c-42f3e58bac7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:17.014877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:17.014877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:17.027546 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-8c3a9b8d-f5b0-403a-8387-56427dc79f56 req-8f497d04-66b1-4176-9d3c-42f3e58bac7e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:17.029077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-8c3a9b8d-f5b0-403a-8387-56427dc79f56 req-8f497d04-66b1-4176-9d3c-42f3e58bac7e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:17.050895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-8c3a9b8d-f5b0-403a-8387-56427dc79f56 req-8f497d04-66b1-4176-9d3c-42f3e58bac7e service nova] Creating event network-changed:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:24:17.065764 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-8c3a9b8d-f5b0-403a-8387-56427dc79f56 req-8f497d04-66b1-4176-9d3c-42f3e58bac7e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201643 Feb 12 04:24:17.066447 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 363/755] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:17.101232 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] HTTP exception thrown: Instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 is not attached to volume 1c231134-7583-4349-8116-c50bcd2b3a45 Feb 12 04:24:17.101869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Returning 404 to user: Instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 is not attached to volume 1c231134-7583-4349-8116-c50bcd2b3a45 {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:24:17.102716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e8cdf103-c4cf-4a2d-8525-66d1d2c8acb1 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments/1c231134-7583-4349-8116-c50bcd2b3a45" status: 404 len: 154 microversion: 2.1 time: 0.110346 Feb 12 04:24:17.103281 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 393/756] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:24:16 2022] DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4/os-volume_attachments/1c231134-7583-4349-8116-c50bcd2b3a45 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:24:18.403532 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:18.404140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:18.410505 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:18.410982 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:18.411768 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:18.412202 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:18.438979 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:24:18.894975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-513d10fc-d9ee-4fbe-863f-5ea6eff31ae0 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 204 len: 0 microversion: 2.1 time: 0.495998 Feb 12 04:24:18.897855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 364/757] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:24:18 2022] DELETE /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:24:18.903510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:18.904106 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:18.910925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:18.911378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:18.912163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:18.912599 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:19.072353 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:19.080627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-22c5a801-e064-4376-b352-4fb9dcbbf9d6 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1553 microversion: 2.1 time: 0.180724 Feb 12 04:24:19.081196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 394/758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:18 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:20.100577 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:20.101317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:20.107609 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:20.108303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:20.109108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:20.110710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:20.247675 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:20.254084 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d9f1835d-2b1b-48bd-acc2-7415862dc070 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1553 microversion: 2.1 time: 0.157740 Feb 12 04:24:20.254641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 365/759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:20 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:20.261405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1774618332", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "3c985467-9548-4781-b2ad-e0cf666ef6d7"}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:20.313903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] validate_networks() for [('3c985467-9548-4781-b2ad-e0cf666ef6d7', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:24:20.758004 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:24:20.758561 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:24:20.758905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:24:20.761681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:24:20.762290 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:24:20.770980 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:20.771432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:20.772279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:20.772738 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:20.788799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Getting quotas for project 39ab8e144b0f47c89a645f14e18fe9f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:24:20.792935 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Getting quotas for user c864bd9e8acc4d65ac2e58e0fb1ea6fe and project 39ab8e144b0f47c89a645f14e18fe9f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:24:20.804274 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:24:20.806576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:24:20.972420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9d5688a2-b64d-46cd-8cbe-9d6925e8a178 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714880 Feb 12 04:24:20.973054 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 395/760] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:24:20.983148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-30363531-73e9-412d-b3ac-6c9a22308913 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:20.986291 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-30363531-73e9-412d-b3ac-6c9a22308913 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:21.058620 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-30363531-73e9-412d-b3ac-6c9a22308913 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:21.065880 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-30363531-73e9-412d-b3ac-6c9a22308913 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1214 microversion: 2.1 time: 0.086804 Feb 12 04:24:21.075656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 366/761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:20 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:21.271265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:21.272120 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:21.279413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:21.280216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:21.281333 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:21.282154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:21.306726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-e3a65de7-4cb0-48b8-a2ab-3d9ef760c3af req-f86cab33-9fb6-450f-9e69-c89edd0121e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31a136c-eb25-47f3-87b9-7cfde7123fb4", "name": "network-vif-deleted", "tag": "dd02aa9e-3381-43c8-b1fd-9ad35f7198ea"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:21.308387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:21.308387 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:21.317137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-e3a65de7-4cb0-48b8-a2ab-3d9ef760c3af req-f86cab33-9fb6-450f-9e69-c89edd0121e9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:21.317600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-e3a65de7-4cb0-48b8-a2ab-3d9ef760c3af req-f86cab33-9fb6-450f-9e69-c89edd0121e9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:21.328793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-e3a65de7-4cb0-48b8-a2ab-3d9ef760c3af req-f86cab33-9fb6-450f-9e69-c89edd0121e9 service nova] Creating event network-vif-deleted:dd02aa9e-3381-43c8-b1fd-9ad35f7198ea for instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 on hv-cinder-82869 Feb 12 04:24:21.334934 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-e3a65de7-4cb0-48b8-a2ab-3d9ef760c3af req-f86cab33-9fb6-450f-9e69-c89edd0121e9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Feb 12 04:24:21.339002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 367/762] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:21.358851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6aef15658546e7a2f0592119184000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:21.367102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f4ab52c6-3d63-4e18-a3c3-32b3ba492c78 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 200 len: 1511 microversion: 2.1 time: 0.099806 Feb 12 04:24:21.367672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 396/763] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:21 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:22.083530 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-046cccb0-0a2c-4abd-9e68-2c90ed242937 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:22.084231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-046cccb0-0a2c-4abd-9e68-2c90ed242937 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:22.141214 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-046cccb0-0a2c-4abd-9e68-2c90ed242937 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:22.147853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-046cccb0-0a2c-4abd-9e68-2c90ed242937 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1214 microversion: 2.1 time: 0.068447 Feb 12 04:24:22.148414 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 368/764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:22 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:22.383802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:22.384428 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] [instance: b31a136c-eb25-47f3-87b9-7cfde7123fb4] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:22.390790 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.391237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.392015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.392450 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.405147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] HTTP exception thrown: Instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 could not be found. Feb 12 04:24:22.406308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Returning 404 to user: Instance b31a136c-eb25-47f3-87b9-7cfde7123fb4 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:24:22.407141 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-14b1926a-ae49-4cc2-8647-a5db4d7d7724 tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4" status: 404 len: 111 microversion: 2.1 time: 0.027048 Feb 12 04:24:22.407690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 397/765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:22 2022] GET /compute/v2.1/servers/b31a136c-eb25-47f3-87b9-7cfde7123fb4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:24:22.415904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9f19be40-b16e-4907-84d6-2a16fc942b4b tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] Calling method '.version_select at 0x7f8e68508700>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:22.524240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9f19be40-b16e-4907-84d6-2a16fc942b4b tempest-TestMinimumBasicScenario-956259441 tempest-TestMinimumBasicScenario-956259441-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2053435355" status: 202 len: 0 microversion: 2.1 time: 0.112001 Feb 12 04:24:22.524821 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 369/766] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 04:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2053435355 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:24:22.753950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:22.754925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:22.760808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.761255 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.766517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.766517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.791267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-73051cab-2c3b-4c3b-845f-7bf317fa79be tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041539 Feb 12 04:24:22.791841 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 398/767] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:24:22 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:24:22.848487 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:22.849245 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:22.855142 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.855591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.856367 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:22.856800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:22.887760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:24:23.165103 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:23.165730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:23.171508 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:23.172023 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:23.172737 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:23.173166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:23.233958 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:23.241896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e1037a76-80b7-4c28-b512-a4895e46be21 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1266 microversion: 2.1 time: 0.080498 Feb 12 04:24:23.242453 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 399/768] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:23 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:23.484759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-555dd56b-803a-4443-9cdd-fcfa58058cac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 204 len: 0 microversion: 2.1 time: 0.639009 Feb 12 04:24:23.485586 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 370/769] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:24:22 2022] DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:24:23.494945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:23.495548 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:23.503136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:23.503725 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:23.504588 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:23.505078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:23.635210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:23.642619 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4abd92bb-0913-4cbc-93b5-a5825167c444 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1671 microversion: 2.1 time: 0.151365 Feb 12 04:24:23.643175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 400/770] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:23 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:24.259768 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:24.260576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:24.266529 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:24.270256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:24.270256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:24.270256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:24.331013 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:24.339045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fc977335-53f7-48c2-ac7a-a959c9539472 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1272 microversion: 2.1 time: 0.083705 Feb 12 04:24:24.339820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 371/771] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:24 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:24.660411 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:24.661083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:24.667558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:24.668027 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:24.668842 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:24.669305 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:24.807770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:24.816499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-35da375c-7317-412c-952b-9982781b9bac tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1671 microversion: 2.1 time: 0.160478 Feb 12 04:24:24.817084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 401/772] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:24 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:25.355886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:25.356496 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:25.363650 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:25.364101 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:25.364884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:25.365337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:25.509469 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:25.517385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ea2f93bb-d52e-4f66-a309-721af33fd781 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.165139 Feb 12 04:24:25.517954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 372/773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:25 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:25.833459 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:25.834125 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:25.840605 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:25.841136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:25.842215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:25.842873 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:26.065501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:26.074346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-663cc5f9-c43c-4147-abd9-e0e3b738f3da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1671 microversion: 2.1 time: 0.244568 Feb 12 04:24:26.085067 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 402/774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:25 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1671 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:26.215394 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-c4baece1-9920-467f-8b99-c029d07cd55a req-a15164a0-9395-4937-8af5-50d5e0d6a067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd3a55d-e058-4418-80d3-4e8c0235a3a7", "tag": "daa73925-0c4f-4cb0-8fc9-3a64bcb56224"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:26.219637 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:26.219637 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:26.230970 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-c4baece1-9920-467f-8b99-c029d07cd55a req-a15164a0-9395-4937-8af5-50d5e0d6a067 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:26.238219 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-c4baece1-9920-467f-8b99-c029d07cd55a req-a15164a0-9395-4937-8af5-50d5e0d6a067 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:26.244523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-c4baece1-9920-467f-8b99-c029d07cd55a req-a15164a0-9395-4937-8af5-50d5e0d6a067 service nova] Creating event network-changed:daa73925-0c4f-4cb0-8fc9-3a64bcb56224 for instance 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 on hv-cinder-82869 Feb 12 04:24:26.250145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-c4baece1-9920-467f-8b99-c029d07cd55a req-a15164a0-9395-4937-8af5-50d5e0d6a067 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043427 Feb 12 04:24:26.251384 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 373/775] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:26.534184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:26.534712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:26.540571 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:26.541016 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:26.541870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:26.542291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:27.070766 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:27.079034 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f98de691-888e-4e86-9063-2df0b31f5d6d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.548511 Feb 12 04:24:27.089808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 403/776] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:26 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:27.092614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:27.096010 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:27.102634 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:27.103012 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:27.103796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:27.104710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:27.250066 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:27.261681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a5529f3d-0693-45a0-be5d-7635360858f8 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1605 microversion: 2.1 time: 0.173388 Feb 12 04:24:27.262330 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 374/777] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:27 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1605 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:27.455319 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-096c3d8f-925c-4073-ac4b-fe8819e5ce14 req-0610104b-6c99-42e0-b7d2-64ff8382f129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7", "name": "network-vif-deleted", "tag": "781b9705-45e9-4f7b-a755-a236654ca737"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:27.457092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:27.457092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:27.471810 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-096c3d8f-925c-4073-ac4b-fe8819e5ce14 req-0610104b-6c99-42e0-b7d2-64ff8382f129 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:27.472259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-096c3d8f-925c-4073-ac4b-fe8819e5ce14 req-0610104b-6c99-42e0-b7d2-64ff8382f129 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:27.494488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-096c3d8f-925c-4073-ac4b-fe8819e5ce14 req-0610104b-6c99-42e0-b7d2-64ff8382f129 service nova] Creating event network-vif-deleted:781b9705-45e9-4f7b-a755-a236654ca737 for instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 on hv-cinder-82869 Feb 12 04:24:27.506585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-096c3d8f-925c-4073-ac4b-fe8819e5ce14 req-0610104b-6c99-42e0-b7d2-64ff8382f129 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219568 Feb 12 04:24:27.509509 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 404/778] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:28.097115 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:28.097946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:28.104453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:28.104902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:28.105743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:28.106175 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:28.279260 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:28.280068 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:28.280868 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:28.288473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:28.289197 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:28.290393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:28.291048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:28.298038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-742afd53-3420-46ee-97b2-424f456e5eec tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.204496 Feb 12 04:24:28.300710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 375/779] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:28 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:28.331097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:28.331775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:28.332378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lazy-loading 'fault' on Instance uuid b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:24:28.374806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:28.382984 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c24f1b73-8cd2-4ec4-8f4e-7735eb74d538 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 200 len: 1326 microversion: 2.1 time: 0.107044 Feb 12 04:24:28.383560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 405/780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:28 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:29.315050 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:29.316342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:29.323675 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:29.324077 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:29.335684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:29.335684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:29.399848 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:29.400394 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:29.414435 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:29.414993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:29.415918 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:29.416419 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:29.438834 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. Feb 12 04:24:29.441160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:24:29.442967 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-82900628-2381-420b-a54a-cd4fd1548968 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 404 len: 111 microversion: 2.1 time: 0.046374 Feb 12 04:24:29.444729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 406/781] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:29 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:24:29.453029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c121b0d5-485c-44a2-bb49-b73fcb019597 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '.version_select at 0x7f8e68cd7d30>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:29.505819 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:29.514012 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ef710fc8-c6de-4a35-833a-0af901d666e3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.202194 Feb 12 04:24:29.514899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 376/782] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:29 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:29.540375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c121b0d5-485c-44a2-bb49-b73fcb019597 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495914876" status: 202 len: 0 microversion: 2.1 time: 0.091308 Feb 12 04:24:29.541179 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 407/783] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 04:24:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495914876 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:24:30.341391 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: .version_select at 0x7f8e6835e9d0>, body: {"keypair": {"name": "tempest-keypair-1247874361"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:30.355278 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:24:30.360300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:24:30.530478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:30.531240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:30.534522 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:24:30.539870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:30.540441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:30.541483 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:30.542139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:30.542703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:24:30.569340 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f9535813-cdb0-427d-9b69-6311202221f9 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.231527 Feb 12 04:24:30.576054 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 377/784] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 04:24:30 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:30.770824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:30.777915 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3da57adf-2f96-4bd1-ac09-46bf2e209010 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.251088 Feb 12 04:24:30.778470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 408/785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:30 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:31.309080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:31.309671 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:31.316038 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.316482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:31.317250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.317703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:31.346681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lazy-loading 'flavor' on Instance uuid 5e28932f-789d-4692-aabf-13afc5f49e67 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:24:31.798302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:31.799041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:31.807785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.808385 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:31.809318 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.809928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:31.957462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8314e995-7878-4922-9e69-9d9022af0bd3 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/action" status: 202 len: 0 microversion: 2.20 time: 0.764174 Feb 12 04:24:31.961925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 378/786] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 04:24:31 2022] POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 12 04:24:31.970093 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:31.971670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:31.990048 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.990611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:31.991412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:31.991851 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:32.331878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:32.344255 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7e61e237-31e1-4755-be7f-aaa050bc4f30 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.552405 Feb 12 04:24:32.344905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 409/787] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:31 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:32.547094 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-e5a1d14c-724d-494c-94d4-d4dadf337b44 req-0d25320c-5909-4048-8bcd-bf48dfe41ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd3a55d-e058-4418-80d3-4e8c0235a3a7", "name": "network-vif-plugged", "status": "completed", "tag": "daa73925-0c4f-4cb0-8fc9-3a64bcb56224"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:32.548682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:32.548682 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:32.555485 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-e5a1d14c-724d-494c-94d4-d4dadf337b44 req-0d25320c-5909-4048-8bcd-bf48dfe41ec4 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:32.555936 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-e5a1d14c-724d-494c-94d4-d4dadf337b44 req-0d25320c-5909-4048-8bcd-bf48dfe41ec4 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:32.572372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-e5a1d14c-724d-494c-94d4-d4dadf337b44 req-0d25320c-5909-4048-8bcd-bf48dfe41ec4 service nova] Creating event network-vif-plugged:daa73925-0c4f-4cb0-8fc9-3a64bcb56224 for instance 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 on hv-cinder-82869 Feb 12 04:24:32.576198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:32.589838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:32.593262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:32.595738 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-e5a1d14c-724d-494c-94d4-d4dadf337b44 req-0d25320c-5909-4048-8bcd-bf48dfe41ec4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114336 Feb 12 04:24:32.597200 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-1d9ab7aa-7a74-47e1-916b-7a53041cd172 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.634322 Feb 12 04:24:32.609467 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 379/788] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:31 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:32.609636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 410/789] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:33.362092 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:33.362794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:33.369340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:33.369799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:33.370613 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:33.371047 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:33.615482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:33.616091 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:33.622453 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:33.622902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:33.623688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:33.624126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:33.636383 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:33.645409 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1990204f-0e40-4a9e-9e7c-dc32ae29fc61 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1314 microversion: 2.1 time: 0.287738 Feb 12 04:24:33.646481 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 411/790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:33 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:33.858966 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:33.872550 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:33.874118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:33.876746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7e588ccd-e86e-4668-b287-8b9dec16a4ba tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.264497 Feb 12 04:24:33.888591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 380/791] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:33 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:34.220642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-576092738", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "306165a8-01e9-47a6-9b7a-50f5488101e0"}], "security_groups": [{"name": "tempest-securitygroup--2106776091"}], "key_name": "tempest-keypair-1247874361", "user_data": "}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:34.346430 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] validate_networks() for [('306165a8-01e9-47a6-9b7a-50f5488101e0', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:24:34.662393 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:34.663113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:34.669584 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.670104 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.670950 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.671961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.741377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:24:34.741822 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:24:34.742261 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:24:34.742676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:24:34.743081 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:24:34.751794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.752265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.753155 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.753626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.770458 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for project e56e0fac86874323b726d0897d3cd6e5. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:24:34.774422 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Getting quotas for user 19c700111c474ff596979fb4150fa15c and project e56e0fac86874323b726d0897d3cd6e5. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:24:34.786412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:24:34.788754 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:24:34.821191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:34.829017 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e98aad3d-2ff9-4bb8-8318-4d2878ad45db tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1498 microversion: 2.1 time: 0.170243 Feb 12 04:24:34.834813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 381/792] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:34 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:34.897203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:34.897203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:34.900256 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e7a00f87-bfdd-4e06-bae0-8ec5567e0c13 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683777 Feb 12 04:24:34.902020 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 412/793] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:24:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 04:24:34.904538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.905170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.906879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:34.907651 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:34.913107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7bf108c0-c10e-4304-8975-a340929af765 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:34.913107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7bf108c0-c10e-4304-8975-a340929af765 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:34.981128 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7bf108c0-c10e-4304-8975-a340929af765 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:34.990466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7bf108c0-c10e-4304-8975-a340929af765 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1237 microversion: 2.1 time: 0.081254 Feb 12 04:24:34.993151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 413/794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:34 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:35.161554 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:35.169513 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:35.171052 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:35.172237 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0b59a68a-ed20-45ab-83a6-3bce34f7345d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.280330 Feb 12 04:24:35.172794 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 382/795] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:34 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:35.809733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:35.810252 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:35.817840 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:35.818285 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:35.819058 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:35.819488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:35.842690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:24:36.008811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:36.009460 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:36.015337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.015789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.016580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.017015 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.088578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:36.096243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8c4e053f-1bf5-4dc3-ad63-70b5db404ddf tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1241 microversion: 2.1 time: 0.091608 Feb 12 04:24:36.096814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 383/796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:36 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:36.137144 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-17ba1ee6-ed94-4419-abb0-1c8d8e2d0481 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 204 len: 0 microversion: 2.1 time: 0.330487 Feb 12 04:24:36.137846 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 414/797] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:24:35 2022] DELETE /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:24:36.145642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:36.146345 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:36.152215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.152658 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.153462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.153893 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.190680 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:36.191563 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:36.197420 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.197887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.198659 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:36.199093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:36.386477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:36.395884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a75a3bae-df79-47b9-920e-09f8c4caec52 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1504 microversion: 2.1 time: 0.253778 Feb 12 04:24:36.400895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 384/798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:36 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:36.401042 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:36.409107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:36.410649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:36.411948 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ff6f47f3-9f4f-4ecc-9a35-29a724452069 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.225364 Feb 12 04:24:36.412692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 415/799] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:36 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:37.113853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:37.115119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:37.121977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.122774 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.123795 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.124966 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.191875 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:37.199693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3a4f6cb9-554c-4ced-9e2b-c6a3b498321b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1297 microversion: 2.1 time: 0.089668 Feb 12 04:24:37.200319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 385/800] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:37 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:37.412121 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:37.412886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:37.419127 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.419574 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.420347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.420781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.429729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:37.430367 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:37.436168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.436617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.438006 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:37.438443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:37.626875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:37.631152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:37.634719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9757fca0-4eff-4269-a1d1-0c94bf3f8b84 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1504 microversion: 2.1 time: 0.226217 Feb 12 04:24:37.635512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 416/801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:37 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:37.639530 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:37.641629 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:37.647954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-98893ac4-10e7-41ff-a73f-ecd38cdde017 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.217426 Feb 12 04:24:37.647954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 386/802] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:37 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:38.217475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:38.217579 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:38.228739 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.229189 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.230002 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.230430 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.323928 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-700ae6d9-ef03-4a3e-9e97-3cc3b245ada0 req-5608b6e6-72e2-4412-b3ac-93e577745079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd3a55d-e058-4418-80d3-4e8c0235a3a7", "name": "network-vif-deleted", "tag": "daa73925-0c4f-4cb0-8fc9-3a64bcb56224"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:38.326243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:38.326243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:38.334436 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-700ae6d9-ef03-4a3e-9e97-3cc3b245ada0 req-5608b6e6-72e2-4412-b3ac-93e577745079 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.335180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-700ae6d9-ef03-4a3e-9e97-3cc3b245ada0 req-5608b6e6-72e2-4412-b3ac-93e577745079 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.350338 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-700ae6d9-ef03-4a3e-9e97-3cc3b245ada0 req-5608b6e6-72e2-4412-b3ac-93e577745079 service nova] Creating event network-vif-deleted:daa73925-0c4f-4cb0-8fc9-3a64bcb56224 for instance 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 on hv-cinder-82869 Feb 12 04:24:38.355525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-700ae6d9-ef03-4a3e-9e97-3cc3b245ada0 req-5608b6e6-72e2-4412-b3ac-93e577745079 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035466 Feb 12 04:24:38.357199 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 387/803] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:38.420636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:38.429296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4988212a-5c21-49e5-8150-cf32eacc8f7b tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.216030 Feb 12 04:24:38.436382 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 417/804] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:38 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:38.652587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:38.653294 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:38.659861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.660318 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.665119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.665119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.665488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:38.665488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:38.672242 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.672884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.673699 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.674170 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.694412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:38.694850 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:38.695466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lazy-loading 'fault' on Instance uuid 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:24:38.766441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:38.775564 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0d9ba044-ad72-4bfd-8b4e-af3a8a37fad4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 200 len: 1304 microversion: 2.1 time: 0.126902 Feb 12 04:24:38.786064 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 388/805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:38 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:38.852106 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:38.860733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:38.862304 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:38.863476 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6de887c5-a390-4e0b-a1e6-41ede6bbe1ff tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.204283 Feb 12 04:24:38.864039 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 418/806] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:38 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:39.000251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-80ea1eca-b39f-4738-a991-e2312e27e384 req-e85ef47d-ebee-47c0-b02f-8ee89dc0193c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749f3838-657b-45ae-8308-44f351782d53", "tag": "88b8851d-a48f-4164-a81a-2ecdda592e6d"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:39.002001 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:39.002001 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:39.008826 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-80ea1eca-b39f-4738-a991-e2312e27e384 req-e85ef47d-ebee-47c0-b02f-8ee89dc0193c service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.009263 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-80ea1eca-b39f-4738-a991-e2312e27e384 req-e85ef47d-ebee-47c0-b02f-8ee89dc0193c service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.022137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-80ea1eca-b39f-4738-a991-e2312e27e384 req-e85ef47d-ebee-47c0-b02f-8ee89dc0193c service nova] Creating event network-changed:88b8851d-a48f-4164-a81a-2ecdda592e6d for instance 749f3838-657b-45ae-8308-44f351782d53 on hv-cinder-82869 Feb 12 04:24:39.028267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-80ea1eca-b39f-4738-a991-e2312e27e384 req-e85ef47d-ebee-47c0-b02f-8ee89dc0193c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Feb 12 04:24:39.029178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 389/807] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:39.451437 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:39.451976 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:39.457997 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.458443 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.459215 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.459648 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.592214 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:39.600237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-810d31f8-d22e-4ccb-b1a0-14b0388d1382 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.153005 Feb 12 04:24:39.600895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 419/808] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:39 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:39.792948 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:39.793729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: 5dd3a55d-e058-4418-80d3-4e8c0235a3a7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:39.799798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.800240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.801011 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.801482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.814998 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] HTTP exception thrown: Instance 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 could not be found. Feb 12 04:24:39.815575 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Returning 404 to user: Instance 5dd3a55d-e058-4418-80d3-4e8c0235a3a7 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:24:39.816381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-865db096-b233-43d2-8bf7-9b2d6f621bbf tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7" status: 404 len: 111 microversion: 2.1 time: 0.027726 Feb 12 04:24:39.816892 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 390/809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:39 2022] GET /compute/v2.1/servers/5dd3a55d-e058-4418-80d3-4e8c0235a3a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:24:39.881709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:39.882791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:39.888960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.889602 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.890974 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:39.891405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:39.976118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1527434131", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452", "networks": [{"uuid": "3c985467-9548-4781-b2ad-e0cf666ef6d7"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:40.033681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] validate_networks() for [('3c985467-9548-4781-b2ad-e0cf666ef6d7', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:24:40.036899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:40.044831 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:40.051107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:40.052391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-013726c6-8484-450b-8652-e11a61c9d773 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.174535 Feb 12 04:24:40.053022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 420/810] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:39 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:40.478623 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:24:40.479051 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:24:40.479523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:24:40.480029 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:24:40.480443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:24:40.490039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:40.490759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:40.491612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:40.492090 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:40.507822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Getting quotas for project 39ab8e144b0f47c89a645f14e18fe9f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:24:40.512231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Getting quotas for user c864bd9e8acc4d65ac2e58e0fb1ea6fe and project 39ab8e144b0f47c89a645f14e18fe9f1. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:24:40.523531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:24:40.527462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:24:40.617611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:40.618224 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:40.623977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:40.624921 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:40.625779 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:40.626244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:40.667541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a74a1672-0634-4be9-9428-4a919ef5e9b0 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695136 Feb 12 04:24:40.668410 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 391/811] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 04:24:40.678095 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f9977300-a4b3-4e01-b8e4-438dae3e10b2 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:40.678702 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f9977300-a4b3-4e01-b8e4-438dae3e10b2 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:40.736834 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f9977300-a4b3-4e01-b8e4-438dae3e10b2 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:40.744331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f9977300-a4b3-4e01-b8e4-438dae3e10b2 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1214 microversion: 2.1 time: 0.069819 Feb 12 04:24:40.748051 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 392/812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:40 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:40.808229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:40.815812 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7dd32543-b9be-43f1-a5d2-c3f851591522 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.202323 Feb 12 04:24:40.816367 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 421/813] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:40 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:41.071537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:41.072177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:41.079953 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.080395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.081336 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.081766 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.212695 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:41.221194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:41.222796 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:41.223946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-05495444-35b1-4b4e-a07d-1f301b80259a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.156427 Feb 12 04:24:41.224509 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 393/814] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:41 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:41.761157 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:41.761881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:41.768783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.769234 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.770038 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.770469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.830065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:41.832792 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:41.833528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:41.837442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5c88c957-0901-4969-9807-6aa440cc67c4 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1218 microversion: 2.1 time: 0.079916 Feb 12 04:24:41.838008 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 422/815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:41 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:41.839466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.839910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.840718 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:41.841144 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:41.976614 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:41.984207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e0fa98c1-7a26-4e3d-9666-7b87db566854 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.155319 Feb 12 04:24:41.984783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 394/816] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:41 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:24:42.242688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:42.243218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:42.249079 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:42.249585 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:42.250397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:42.250828 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:42.380910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:42.388688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:42.390725 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:42.391881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5198dfa4-8621-4635-ac66-5d46101dbac9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.153011 Feb 12 04:24:42.392438 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 423/817] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:42 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:42.853157 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:42.853825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:42.860919 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:42.861389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:42.862149 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:42.862576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:42.942121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:42.949950 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-aee68bb1-dd41-4369-8e2f-8523129666f3 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1274 microversion: 2.1 time: 0.100391 Feb 12 04:24:42.961159 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 395/818] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:42 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:42.999906 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:43.000603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:43.006822 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.007395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:43.008044 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.008475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:43.150568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:43.158417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1aaad4f8-7672-48a7-a24f-75fe24eecf36 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.162218 Feb 12 04:24:43.158977 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 424/819] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:42 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:43.409413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:43.410035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:43.415993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.416440 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:43.417216 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.417732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:43.566519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:43.575485 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:43.577137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:43.578347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6d491c04-26d4-468d-a6dd-5f600d2a5984 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.173260 Feb 12 04:24:43.578904 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 396/820] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:43 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:43.967646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:43.968814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:43.974883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.975335 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:43.976113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:43.976669 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.128145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:44.135402 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-77265418-95b9-49c1-8450-f5f8062e255d tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.171436 Feb 12 04:24:44.135963 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 425/821] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:43 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:44.174379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:44.174991 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:44.181185 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.187217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.187217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.187217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.314490 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:44.322553 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-186d2c20-b8bc-49cf-b78c-79c147ca503a tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.151749 Feb 12 04:24:44.323399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 397/822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:44 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:44.355244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-3a1f8780-b90b-4438-acb0-37d17bb5231c req-8b1eb418-c05d-47d1-82b0-0db71b3530c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13d1f26-39c9-42d4-90e8-2a0d7db044eb", "tag": "184e1ef3-5abf-44d4-ac0f-0f7d4be77477"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:44.356837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:44.356837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:44.364271 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-3a1f8780-b90b-4438-acb0-37d17bb5231c req-8b1eb418-c05d-47d1-82b0-0db71b3530c7 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.364728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-3a1f8780-b90b-4438-acb0-37d17bb5231c req-8b1eb418-c05d-47d1-82b0-0db71b3530c7 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.385550 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-3a1f8780-b90b-4438-acb0-37d17bb5231c req-8b1eb418-c05d-47d1-82b0-0db71b3530c7 service nova] Creating event network-changed:184e1ef3-5abf-44d4-ac0f-0f7d4be77477 for instance a13d1f26-39c9-42d4-90e8-2a0d7db044eb on hv-cinder-82869 Feb 12 04:24:44.388440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-3a1f8780-b90b-4438-acb0-37d17bb5231c req-8b1eb418-c05d-47d1-82b0-0db71b3530c7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036463 Feb 12 04:24:44.389017 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 426/823] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:44.599472 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:44.600183 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:44.607201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.611276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.611276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.611276 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.758085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-d9f5d342-09f1-4e08-aee3-70124428403a req-76dd6faf-9b84-49cb-852e-deba6bdb20f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749f3838-657b-45ae-8308-44f351782d53", "name": "network-vif-plugged", "status": "completed", "tag": "88b8851d-a48f-4164-a81a-2ecdda592e6d"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:44.759728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:44.759728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:44.767338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d9f5d342-09f1-4e08-aee3-70124428403a req-76dd6faf-9b84-49cb-852e-deba6bdb20f8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:44.767859 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d9f5d342-09f1-4e08-aee3-70124428403a req-76dd6faf-9b84-49cb-852e-deba6bdb20f8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:44.773461 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:44.779095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-d9f5d342-09f1-4e08-aee3-70124428403a req-76dd6faf-9b84-49cb-852e-deba6bdb20f8 service nova] Creating event network-vif-plugged:88b8851d-a48f-4164-a81a-2ecdda592e6d for instance 749f3838-657b-45ae-8308-44f351782d53 on hv-cinder-82869 Feb 12 04:24:44.783756 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:44.783956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-d9f5d342-09f1-4e08-aee3-70124428403a req-76dd6faf-9b84-49cb-852e-deba6bdb20f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030315 Feb 12 04:24:44.784752 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 427/824] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:44.786060 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:44.787663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-78ac072f-9ef0-43a6-ab50-daac29e51027 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.192220 Feb 12 04:24:44.788581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 398/825] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:44 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:45.155030 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:45.156348 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:45.162475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.163004 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.163870 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.164375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.295119 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:45.302521 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fd9cb9be-28b7-4e5e-8678-f2382cc9ea40 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.152005 Feb 12 04:24:45.303084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 428/826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:45 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:45.339829 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:45.340432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:45.347230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.347672 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.348431 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.348855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.723303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:45.730559 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f111c1d7-8b2b-4a64-8133-324c844d93de tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1363 microversion: 2.1 time: 0.394339 Feb 12 04:24:45.731151 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 399/827] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:45 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:45.807180 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:45.807807 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:45.814145 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.814587 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.815354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:45.815784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:45.943237 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:45.950910 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:45.953061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:45.954244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-08f87dd8-7d25-453e-97b6-8651e1462c36 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.150769 Feb 12 04:24:45.954811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 429/828] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:45 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:46.319619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:46.320529 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:46.326609 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.327129 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.328020 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.328521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.475594 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:46.486021 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-deed9732-5e60-4dd3-a5fe-71db535a7e90 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.170096 Feb 12 04:24:46.486694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 400/829] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:46 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:46.747476 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:46.748077 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:46.754541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.755025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.755799 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.756229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.885098 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:46.893223 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0b3e1cb1-7a46-492c-ba39-86ead2cbef4c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1550 microversion: 2.1 time: 0.149518 Feb 12 04:24:46.894118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 430/830] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:46 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:46.909835 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:46.910328 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:46.916073 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.916526 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.917317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.917755 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.972737 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:46.973423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:46.979504 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.979950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.980726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:46.981160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:46.998500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ddd306df-741f-4e2c-92ca-ca660266e22e tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092999 Feb 12 04:24:46.999212 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 401/831] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 04:24:46 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:47.276261 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:47.286308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:47.287816 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:47.288989 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-527ba1c2-389e-47c1-9d47-99bc67721617 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.320025 Feb 12 04:24:47.289575 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 431/832] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:46 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:47.504061 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:47.504663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:47.510701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:47.511145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:47.511919 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:47.512352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:47.649081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:47.656302 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-40ac3199-b1c4-4628-aa27-10559b6dde95 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.157060 Feb 12 04:24:47.658065 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 402/833] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:47 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:48.162641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:48.163123 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:48.169684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.170216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.171089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-598ce36f-d96d-4f69-81ac-23cf002d932b req-9349bbe9-bccd-4276-96ea-287b488333db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749f3838-657b-45ae-8308-44f351782d53", "tag": "88b8851d-a48f-4164-a81a-2ecdda592e6d"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:48.171229 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.172124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.172664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:48.172664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:48.180307 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-598ce36f-d96d-4f69-81ac-23cf002d932b req-9349bbe9-bccd-4276-96ea-287b488333db service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.180837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-598ce36f-d96d-4f69-81ac-23cf002d932b req-9349bbe9-bccd-4276-96ea-287b488333db service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.194188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-598ce36f-d96d-4f69-81ac-23cf002d932b req-9349bbe9-bccd-4276-96ea-287b488333db service nova] Creating event network-changed:88b8851d-a48f-4164-a81a-2ecdda592e6d for instance 749f3838-657b-45ae-8308-44f351782d53 on hv-cinder-82869 Feb 12 04:24:48.197568 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4a654d73-5fc7-4461-abb2-0d0d6d9c1fd5 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/ips" status: 200 len: 107 microversion: 2.1 time: 0.038514 Feb 12 04:24:48.198177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 432/834] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 04:24:48 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/ips => generated 107 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:48.199593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-598ce36f-d96d-4f69-81ac-23cf002d932b req-9349bbe9-bccd-4276-96ea-287b488333db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032198 Feb 12 04:24:48.200170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 403/835] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:48.308340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:48.309522 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:48.316724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.317463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.318582 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.319296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.556615 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:48.568642 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:48.570178 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:48.571544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d764bdb4-eb3b-4bee-bc92-81938c09933b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1743 microversion: 2.20 time: 0.268349 Feb 12 04:24:48.571953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 433/836] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:48 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:48.673576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:48.674268 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:48.681047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.681659 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.682430 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:48.682841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:48.935235 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:48.942867 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-57992113-d053-4443-bac4-160205db8f0e tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.273887 Feb 12 04:24:48.952089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 404/837] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:48 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:48.992878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-c08c6bb9-2c0e-4994-a309-050848acd9bf req-4d3d490b-2d4f-46eb-ad25-43c197de91ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13d1f26-39c9-42d4-90e8-2a0d7db044eb", "name": "network-vif-plugged", "status": "completed", "tag": "184e1ef3-5abf-44d4-ac0f-0f7d4be77477"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:49.002080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:49.002080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:24:49.002080 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-c08c6bb9-2c0e-4994-a309-050848acd9bf req-4d3d490b-2d4f-46eb-ad25-43c197de91ce service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:49.003006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-c08c6bb9-2c0e-4994-a309-050848acd9bf req-4d3d490b-2d4f-46eb-ad25-43c197de91ce service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:49.013806 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-c08c6bb9-2c0e-4994-a309-050848acd9bf req-4d3d490b-2d4f-46eb-ad25-43c197de91ce service nova] Creating event network-vif-plugged:184e1ef3-5abf-44d4-ac0f-0f7d4be77477 for instance a13d1f26-39c9-42d4-90e8-2a0d7db044eb on hv-cinder-82869 Feb 12 04:24:49.020048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-c08c6bb9-2c0e-4994-a309-050848acd9bf req-4d3d490b-2d4f-46eb-ad25-43c197de91ce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Feb 12 04:24:49.020744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 434/838] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:49.596284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:49.596898 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:49.602659 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:49.603106 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:49.603910 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:49.604350 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:49.748656 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:49.757147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:49.758724 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:49.759939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e055e055-f804-47b5-a9e5-1c284a98e899 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1743 microversion: 2.20 time: 0.167910 Feb 12 04:24:49.760522 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 405/839] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:49 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:49.959869 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:49.960643 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:49.967281 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:49.967795 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:49.968609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:49.969130 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:50.008041 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4daf34e-dd85-4939-b27e-86bd427eb119"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:50.009033 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:50.017801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:50.018525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:50.019981 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:50.022740 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:50.118829 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:50.126354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a43f6dc5-d65e-471d-a932-48ebbba210dd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1314 microversion: 2.1 time: 0.170544 Feb 12 04:24:50.126919 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 435/840] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:49 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:50.777770 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:50.778291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:50.784231 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:50.784676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:50.785469 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:50.786057 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:50.863344 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bff6b9a2-7963-4508-b418-0b0db55ce56d tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859082 Feb 12 04:24:50.864118 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 406/841] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:24:50 2022] POST /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:51.017950 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:51.028054 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:51.029501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:51.031393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6aeff5b6-f067-40db-be31-38163e5a72f1 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.257190 Feb 12 04:24:51.045270 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-d88daedd-ec60-4a39-a9c8-1f91b5bee24f req-d4c3418e-31a0-4ec0-ab8d-877525aac60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "name": "network-vif-plugged", "status": "completed", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:51.046938 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 436/842] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:50 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:51.047525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:51.047525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:51.061655 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-d88daedd-ec60-4a39-a9c8-1f91b5bee24f req-d4c3418e-31a0-4ec0-ab8d-877525aac60e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:51.062693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-d88daedd-ec60-4a39-a9c8-1f91b5bee24f req-d4c3418e-31a0-4ec0-ab8d-877525aac60e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:51.074486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-d88daedd-ec60-4a39-a9c8-1f91b5bee24f req-d4c3418e-31a0-4ec0-ab8d-877525aac60e service nova] Creating event network-vif-plugged:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:24:51.080096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-d88daedd-ec60-4a39-a9c8-1f91b5bee24f req-d4c3418e-31a0-4ec0-ab8d-877525aac60e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Feb 12 04:24:51.081320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 407/843] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:24:51.144188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:51.145218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:51.153606 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:51.154088 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:51.154865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:51.155851 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:51.321444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:51.325924 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8dc22dca-171b-4002-a273-f3a823a28af8 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1498 microversion: 2.1 time: 0.186599 Feb 12 04:24:51.338203 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 437/844] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:51 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:52.056606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:52.057320 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:52.065765 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.066105 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:52.066957 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.067401 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:52.229674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:52.240997 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:52.242775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:52.244120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-df9dfe9c-c199-4ac6-afa6-ccee8d2e36a9 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.191993 Feb 12 04:24:52.255408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 408/845] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:52 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:24:52.460070 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:52.460670 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:52.467138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.467533 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:52.469041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.469510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:52.497905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:24:52.844270 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b4b2c5b6-aabe-4162-910c-d7febbb019f5 tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 204 len: 0 microversion: 2.1 time: 0.387542 Feb 12 04:24:52.845354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 438/846] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:24:52 2022] DELETE /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:24:52.854089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:52.854699 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:52.861331 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.861970 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:52.862802 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:52.863386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:53.024133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:53.036055 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6278c16d-f9fb-44f3-a01b-24d60d861e6f tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1504 microversion: 2.1 time: 0.185757 Feb 12 04:24:53.037578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 409/847] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:52 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:53.265802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:53.266500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:53.272864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:53.273344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:53.274167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:53.274612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:53.431681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:53.440282 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:53.441933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:53.443159 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f6b48665-0767-41ca-99b7-75b8b760a901 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.182658 Feb 12 04:24:53.443719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 439/848] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:53 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:54.053552 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:54.054825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:54.061778 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:54.062223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:54.063028 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:54.063462 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:54.241363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:54.249337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-37476056-1c7f-4a49-9f04-a153397b481b tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1504 microversion: 2.1 time: 0.199331 Feb 12 04:24:54.250140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 410/849] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:54 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:54.462137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:54.462748 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:54.470086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:54.470606 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:54.472560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:54.472560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:54.738580 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:54.747781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:54.749788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:54.751009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2c599a4f-79ee-4c68-bc89-4f43f36f9a78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.292578 Feb 12 04:24:54.751578 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 440/850] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:54 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:55.082039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-4bac3855-f820-4ba3-8217-3300cfd7da23 req-7c639fa3-aaf3-464e-bc3e-3aacbbd0d7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13d1f26-39c9-42d4-90e8-2a0d7db044eb", "name": "network-vif-deleted", "tag": "184e1ef3-5abf-44d4-ac0f-0f7d4be77477"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:24:55.084385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:24:55.084385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:24:55.094098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-4bac3855-f820-4ba3-8217-3300cfd7da23 req-7c639fa3-aaf3-464e-bc3e-3aacbbd0d7ac service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:55.096230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-4bac3855-f820-4ba3-8217-3300cfd7da23 req-7c639fa3-aaf3-464e-bc3e-3aacbbd0d7ac service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:55.107832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-4bac3855-f820-4ba3-8217-3300cfd7da23 req-7c639fa3-aaf3-464e-bc3e-3aacbbd0d7ac service nova] Creating event network-vif-deleted:184e1ef3-5abf-44d4-ac0f-0f7d4be77477 for instance a13d1f26-39c9-42d4-90e8-2a0d7db044eb on hv-cinder-82869 Feb 12 04:24:55.113426 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-4bac3855-f820-4ba3-8217-3300cfd7da23 req-7c639fa3-aaf3-464e-bc3e-3aacbbd0d7ac service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035127 Feb 12 04:24:55.114892 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 411/851] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:55.266747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:55.267784 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:55.279289 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:55.280943 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:55.282111 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:55.282733 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:55.365339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ab8e144b0f47c89a645f14e18fe9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:55.373611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-35ebbadf-0483-4cad-97e1-1acdf841eedd tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 200 len: 1299 microversion: 2.1 time: 0.110850 Feb 12 04:24:55.385577 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 441/852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:55 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:24:55.769156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:55.770116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:55.779853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:55.781237 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:55.782267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:55.782913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:55.928822 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:55.945105 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:55.946986 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:55.948439 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ab2c69c7-3366-4107-b648-623a2bcebd17 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.184178 Feb 12 04:24:55.949160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 412/853] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:55 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:56.394048 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:56.395248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] [instance: a13d1f26-39c9-42d4-90e8-2a0d7db044eb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:56.401685 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:56.402354 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:56.403308 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:56.403745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:56.421060 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] HTTP exception thrown: Instance a13d1f26-39c9-42d4-90e8-2a0d7db044eb could not be found. Feb 12 04:24:56.421690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] Returning 404 to user: Instance a13d1f26-39c9-42d4-90e8-2a0d7db044eb could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:24:56.422537 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0be7548b-08ff-4123-acc0-b77773c2956c tempest-VolumesActionsTest-271796657 tempest-VolumesActionsTest-271796657-project] 10.222.0.31 "GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb" status: 404 len: 111 microversion: 2.1 time: 0.034034 Feb 12 04:24:56.423280 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 442/854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:24:56 2022] GET /compute/v2.1/servers/a13d1f26-39c9-42d4-90e8-2a0d7db044eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:24:56.968871 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:56.969510 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:56.975735 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:56.976173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:56.976943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:56.977404 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:57.121057 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:57.130324 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:57.132236 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:57.136642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8aa0cae5-5d2e-4501-9e9b-4b0849d9a05b tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.168902 Feb 12 04:24:57.136642 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 413/855] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:56 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:58.151662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:58.152612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:58.160372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.161251 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.162324 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.163132 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.315821 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:58.335517 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:58.337031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:58.343537 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7610c26f-171a-41fc-96dd-5a1053a44ab7 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.195499 Feb 12 04:24:58.344238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 443/856] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:58 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:24:58.487046 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:58.489197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:58.496164 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.496829 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.497915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.498873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.535130 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-83a3bd98-c5a7-4f40-9c6e-3c5844473272 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052176 Feb 12 04:24:58.536252 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 414/857] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:24:58 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:58.546082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:58.546721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:58.556150 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.556688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.557603 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:58.558351 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:58.594083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1f26173f-0006-47ff-9fa1-0d4ec4d06e71 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119" status: 200 len: 194 microversion: 2.1 time: 0.051730 Feb 12 04:24:58.599052 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 444/858] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 04:24:58 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:24:59.363244 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:24:59.363854 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:24:59.370056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:59.373938 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:59.374859 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:24:59.375369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:24:59.535727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:59.545458 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:59.548122 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:24:59.549342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0d795411-5276-4e4e-959c-43981bfb7732 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.191009 Feb 12 04:24:59.563082 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 415/859] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:24:59 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:00.568451 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:00.569061 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:00.575416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:00.575863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:00.576637 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:00.577113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:00.722561 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:00.731344 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:00.737467 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:00.738657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0157392a-92c4-4d40-80d0-e6749139bde4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.173918 Feb 12 04:25:00.739210 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 445/860] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:00 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:01.756916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:01.757503 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:01.763687 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:01.764188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:01.765528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:01.765962 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:01.896596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:01.904181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:01.906322 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:01.907530 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bbdc5f98-6188-44e1-8294-0c0f1a3db003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1738 microversion: 2.20 time: 0.154224 Feb 12 04:25:01.908095 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 416/861] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:01 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:02.246811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a458e81e-d5af-454a-a07e-4a32970ada97"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:02.248052 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:02.255009 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:02.255453 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:02.256221 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:02.256683 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:02.928874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:02.930513 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:02.939123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:02.940121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:02.941172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:02.942073 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:03.046121 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-59f29436-d8ee-4ff0-99a2-aa8991c75843 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "POST /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.802899 Feb 12 04:25:03.047035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 446/862] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 04:25:02 2022] POST /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:03.119087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:03.131086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:03.138768 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:03.140176 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b25aea8d-d3d7-4755-8056-7878d5820354 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1720 microversion: 2.20 time: 0.215748 Feb 12 04:25:03.140770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 417/863] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:02 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 04:25:04.163444 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:04.165167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:04.174216 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:04.175288 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:04.176482 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:04.177199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:04.356803 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:04.365358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:04.367085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:04.368246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c025d12f-c960-4318-8d8e-669c9a6e4dcd tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1720 microversion: 2.20 time: 0.213026 Feb 12 04:25:04.368975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 447/864] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:04 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:04.540813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-75a4ad87-fb91-4bd0-bdd4-4a5828200c2e req-dde5f6ac-a12d-4a95-84c6-dcacac8b50c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "name": "network-vif-unplugged", "status": "completed", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:04.543119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:25:04.543119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:25:04.552051 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-75a4ad87-fb91-4bd0-bdd4-4a5828200c2e req-dde5f6ac-a12d-4a95-84c6-dcacac8b50c6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:04.553022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-75a4ad87-fb91-4bd0-bdd4-4a5828200c2e req-dde5f6ac-a12d-4a95-84c6-dcacac8b50c6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:04.565611 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-75a4ad87-fb91-4bd0-bdd4-4a5828200c2e req-dde5f6ac-a12d-4a95-84c6-dcacac8b50c6 service nova] Creating event network-vif-unplugged:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:25:04.570764 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-75a4ad87-fb91-4bd0-bdd4-4a5828200c2e req-dde5f6ac-a12d-4a95-84c6-dcacac8b50c6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033841 Feb 12 04:25:04.571368 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 418/865] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:05.387188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:05.387941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:05.395227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:05.395681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:05.396475 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:05.396925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:05.570043 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:05.579364 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:05.581248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:05.582398 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-147710a6-c335-41ac-9ba8-343db9b64099 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1723 microversion: 2.20 time: 0.199667 Feb 12 04:25:05.583137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 448/866] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:05 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:05.609738 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fafb8feb-8d68-469d-ad4f-be5a53558976"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:05.611170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:05.620749 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:05.621689 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:05.622919 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:05.623499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:06.696470 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0188233f-7f88-4578-95a6-b3993f0edbcf tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.093313 Feb 12 04:25:06.697837 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 419/867] 10.222.0.31 () {62 vars in 1363 bytes} [Sat Feb 12 04:25:05 2022] POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments => generated 188 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 04:25:06.840878 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:06.841441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:06.852379 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:06.853372 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:06.855049 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:06.856323 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:07.477623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f778ec0c-80c1-4071-a7d7-2be08d6c4d4a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments/fafb8feb-8d68-469d-ad4f-be5a53558976" status: 202 len: 0 microversion: 2.20 time: 0.643247 Feb 12 04:25:07.479183 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 449/868] 10.222.0.31 () {60 vars in 1456 bytes} [Sat Feb 12 04:25:06 2022] DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments/fafb8feb-8d68-469d-ad4f-be5a53558976 => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:25:07.548760 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:07.549359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:07.558746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:07.558746 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:07.559718 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:07.560207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:07.799160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e54b0a71-cba0-4fba-ad82-1db4580f7148 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/action" status: 202 len: 0 microversion: 2.20 time: 0.254751 Feb 12 04:25:07.800952 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 420/869] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 04:25:07 2022] POST /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:25:07.809730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:07.809730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:07.818264 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:07.818684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:07.819874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:07.820486 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:07.994140 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:08.001980 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:08.003498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:08.004649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c767a399-717c-48d1-b4e7-89ac18715960 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1671 microversion: 2.20 time: 0.198864 Feb 12 04:25:08.005206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 450/870] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:07 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:09.024619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:09.025229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:09.034841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:09.035474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:09.036463 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:09.036907 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:09.246467 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:09.259688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:09.264344 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:09.266432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c02f98de-113b-4f13-9e9e-6e9ce5fcfa3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1671 microversion: 2.20 time: 0.245943 Feb 12 04:25:09.270242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 421/871] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:09 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:10.293040 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:10.293730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:10.300967 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:10.301452 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:10.302375 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:10.302816 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:10.488272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:10.496112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:10.501466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:10.508280 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b7ea0726-380e-4190-a8e6-8706aca9b221 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.217964 Feb 12 04:25:10.508280 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 451/872] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:10 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:10.742600 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:10.743786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:10.754732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:10.755423 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:10.756504 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:10.756942 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:10.803268 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a0bf080a-a228-404c-a77f-5e9ba39effd4 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064647 Feb 12 04:25:10.804564 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 422/873] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:25:10 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:11.523839 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:11.524479 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:11.534957 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:11.535404 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:11.536387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:11.536777 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:11.707718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:11.717320 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:11.719427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:11.721815 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-39dc1cd2-1230-4963-9092-7818108e4730 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.201505 Feb 12 04:25:11.725186 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 452/874] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:11 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:12.740504 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:12.741182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:12.757685 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:12.758169 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:12.758972 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:12.759595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:12.980007 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:12.992508 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:12.995463 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:12.996896 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5381d6de-b834-4652-93dd-97eea28ff7f6 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.260033 Feb 12 04:25:13.010914 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 423/875] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:12 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:14.016887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:14.017623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:14.036724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:14.037187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:14.039214 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:14.040347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:14.261604 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:14.273204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:14.275501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:14.277199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-476fe57f-cc05-4075-9986-dd47562a71bb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.265291 Feb 12 04:25:14.281084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 453/876] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:14 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:15.301578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:15.302905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:15.309835 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:15.312776 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:15.314016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:15.314632 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:15.496939 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:15.506344 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:15.512385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:15.515317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-91a8a419-ec7b-4489-a4f6-7e14ae602003 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.216823 Feb 12 04:25:15.532827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 424/877] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:15 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:16.540500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:16.541163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:16.564589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:16.564589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:16.568377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:16.569166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:16.836999 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:16.850662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:16.850662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:16.851346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-f41a93c5-c71d-47ea-a0fc-219a28dd0e76 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.315021 Feb 12 04:25:16.866866 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 454/878] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:16 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:17.875285 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:17.909152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:17.909152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:17.909152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:17.909152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:17.909588 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:18.034459 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:18.043846 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:18.045625 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:18.047524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-128f15bb-21fc-42e7-84fb-f97301fd172d tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.177097 Feb 12 04:25:18.048215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 425/879] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:17 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:19.067881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:19.068865 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:19.077964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:19.077964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:19.077964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:19.077964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:19.258651 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:19.267015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:19.268524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:19.269811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-60a4aa8b-35af-42e5-a01f-5339a62841ed tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.206169 Feb 12 04:25:19.270374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 455/880] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:19 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:20.288085 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:20.288703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:20.297784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:20.298349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:20.299152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:20.299592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:20.467413 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:20.478583 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:20.480062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:20.481209 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9b62489d-c34a-4c0e-87cd-7fd576a1973f tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.197045 Feb 12 04:25:20.481782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 426/881] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:20 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:21.499712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:21.500342 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:21.506775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:21.507206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:21.508001 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:21.508507 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:21.641965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:21.649641 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:21.652549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:21.652549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5860468c-5340-4c42-bea5-2856bab35872 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.156916 Feb 12 04:25:21.652846 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 456/882] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:21 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:22.671252 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:22.672002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:22.680405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:22.680405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:22.680405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:22.680688 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:22.817186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:22.825001 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:22.826551 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:22.828246 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b3ca5978-7c15-480b-a683-e85553fdfebe tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.161183 Feb 12 04:25:22.828811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 427/883] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:22 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:23.846478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:23.847066 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:23.853455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:23.853905 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:23.854685 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:23.855123 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:23.995588 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:24.003211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:24.004698 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:24.005876 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1ee7c847-9e47-415b-ac51-21ee3f2127f4 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.163749 Feb 12 04:25:24.006432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 457/884] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:23 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:24.695793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-64812b1f-1555-4f7b-b0fd-d10035624fbf req-ea41315a-0bc3-4594-84ba-855c21c6ff5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "name": "network-vif-plugged", "status": "completed", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:24.698396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:25:24.698396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:25:24.707671 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-64812b1f-1555-4f7b-b0fd-d10035624fbf req-ea41315a-0bc3-4594-84ba-855c21c6ff5f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:24.708124 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-64812b1f-1555-4f7b-b0fd-d10035624fbf req-ea41315a-0bc3-4594-84ba-855c21c6ff5f service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:24.723704 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-64812b1f-1555-4f7b-b0fd-d10035624fbf req-ea41315a-0bc3-4594-84ba-855c21c6ff5f service nova] Creating event network-vif-plugged:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:25:24.734324 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-64812b1f-1555-4f7b-b0fd-d10035624fbf req-ea41315a-0bc3-4594-84ba-855c21c6ff5f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039447 Feb 12 04:25:24.734324 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 428/885] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:25.024194 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:25.024893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:25.031403 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:25.031853 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:25.032631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:25.033059 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:25.213329 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:25.222182 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:25.223688 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:25.224871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1574faf2-4b4b-40c9-b95c-b923c63711d8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.204423 Feb 12 04:25:25.225468 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 458/886] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:25 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:26.243767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:26.244479 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:26.250908 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:26.251349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:26.252121 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:26.252551 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:26.392352 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:26.400419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:26.408433 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:26.409706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e96b4fb1-1662-4e80-a23f-3df24cb32344 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.169979 Feb 12 04:25:26.411602 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 429/887] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:26 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:27.427902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:27.428423 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:27.434687 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:27.435138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:27.435944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:27.437065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:27.570979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:27.579045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:27.580623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:27.581818 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-14b25158-2503-42cb-9b7f-59b15079aadc tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1729 microversion: 2.20 time: 0.157668 Feb 12 04:25:27.582377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 459/888] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:27 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:28.599767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:28.604418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:28.606613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:28.607056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:28.607825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:28.608254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:28.739233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:28.747203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:28.748712 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:28.749888 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-62fa8858-2336-466f-a120-396de1f8a802 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1716 microversion: 2.20 time: 0.153855 Feb 12 04:25:28.750446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 430/889] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:25:28 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:25:33.254528 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:33.255060 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:33.261137 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:33.261611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:33.262377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:33.262803 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:33.290763 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1adf1c2b-6d20-4e5a-ab2c-a7676f7760c0 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119" status: 200 len: 194 microversion: 2.1 time: 0.040654 Feb 12 04:25:33.291338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 460/890] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 04:25:33 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:33.301071 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:33.301587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:33.307701 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:33.308144 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:33.308905 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:33.309354 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:33.388412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lazy-loading 'services' on Instance uuid 749f3838-657b-45ae-8308-44f351782d53 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:25:33.632113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-fec83aa8-7f32-47da-bcc1-36bdfcf38b94 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119" status: 202 len: 0 microversion: 2.1 time: 0.335001 Feb 12 04:25:33.632697 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 431/891] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:25:33 2022] DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/c4daf34e-dd85-4939-b27e-86bd427eb119 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:25:35.788491 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:35.789005 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:35.795230 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:35.795684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:35.796458 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:35.796893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:35.906149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-47f338be-9faa-48d9-8cb1-0eda075224b1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/a458e81e-d5af-454a-a07e-4a32970ada97" status: 200 len: 194 microversion: 2.1 time: 0.121888 Feb 12 04:25:35.906716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 461/892] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 04:25:35 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/a458e81e-d5af-454a-a07e-4a32970ada97 => generated 194 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:35.917684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:35.918283 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:35.924457 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:35.924900 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:35.926386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:35.926818 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:36.002468 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lazy-loading 'services' on Instance uuid 749f3838-657b-45ae-8308-44f351782d53 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:25:36.243438 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-241621c4-52e0-4982-b371-b1982d6e0d45 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/a458e81e-d5af-454a-a07e-4a32970ada97" status: 202 len: 0 microversion: 2.1 time: 0.330030 Feb 12 04:25:36.244052 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 432/893] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 04:25:35 2022] DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments/a458e81e-d5af-454a-a07e-4a32970ada97 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:25:37.404534 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:37.405544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:37.411785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.412241 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.413025 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.413510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.443153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-da7f2b68-83d0-489b-bd7b-63477168384c tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042320 Feb 12 04:25:37.443703 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 462/894] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:25:37 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:25:37.543379 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:37.544378 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:37.550425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.551514 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.552315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.552744 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.580435 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-43c3af20-6d9b-4511-a343-c8de242369da tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041604 Feb 12 04:25:37.580993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 433/895] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 04:25:37 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 04:25:37.634862 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:37.635457 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:37.641202 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.641691 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.642542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:37.642972 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:37.667018 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:25:37.990972 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d7f23bc5-f670-413e-afbb-926a9781f5c2 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 204 len: 0 microversion: 2.1 time: 0.359449 Feb 12 04:25:37.991549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 463/896] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:25:37 2022] DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:25:37.999589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:38.000192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:38.006729 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:38.007182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:38.008115 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:38.008543 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:38.142879 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:38.150687 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-df4e7f82-4636-4d84-8f04-a9ca77105a27 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1674 microversion: 2.1 time: 0.154849 Feb 12 04:25:38.151242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 434/897] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:37 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:25:39.168356 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:39.168980 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:39.175094 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:39.175547 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:39.176327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:39.176771 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:39.306394 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:39.313723 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3776a0f5-b3dc-466c-b107-7240a90d0ff1 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1674 microversion: 2.1 time: 0.149507 Feb 12 04:25:39.314307 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 464/898] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:39 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:25:40.330493 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:40.331229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:40.337862 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:40.338311 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:40.339087 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:40.339519 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:40.541769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:40.550098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-386a1aad-0f90-40f9-8cda-51a2a5379bab tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1674 microversion: 2.1 time: 0.223253 Feb 12 04:25:40.551183 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 435/899] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:40 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:25:40.984803 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-75212535-eb59-45e8-a8f9-a81a2b7157c8 req-7d65c64d-b5fa-43ab-9b0a-d4a85ddc7f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749f3838-657b-45ae-8308-44f351782d53", "name": "network-vif-deleted", "tag": "88b8851d-a48f-4164-a81a-2ecdda592e6d"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:25:40.986338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:25:40.986338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:25:40.994192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-75212535-eb59-45e8-a8f9-a81a2b7157c8 req-7d65c64d-b5fa-43ab-9b0a-d4a85ddc7f2e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:40.994636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-75212535-eb59-45e8-a8f9-a81a2b7157c8 req-7d65c64d-b5fa-43ab-9b0a-d4a85ddc7f2e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:41.005788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-75212535-eb59-45e8-a8f9-a81a2b7157c8 req-7d65c64d-b5fa-43ab-9b0a-d4a85ddc7f2e service nova] Creating event network-vif-deleted:88b8851d-a48f-4164-a81a-2ecdda592e6d for instance 749f3838-657b-45ae-8308-44f351782d53 on hv-cinder-82869 Feb 12 04:25:41.011536 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-75212535-eb59-45e8-a8f9-a81a2b7157c8 req-7d65c64d-b5fa-43ab-9b0a-d4a85ddc7f2e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Feb 12 04:25:41.012302 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 465/900] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:25:41.567180 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:41.567783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:41.574333 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:41.574776 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:41.575544 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:41.575975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:41.607448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:41.607895 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:41.608417 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lazy-loading 'fault' on Instance uuid 749f3838-657b-45ae-8308-44f351782d53 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:25:41.651081 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c700111c474ff596979fb4150fa15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e56e0fac86874323b726d0897d3cd6e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:25:41.657966 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d8ccc8d8-e83c-4ab9-9f8d-eb0801984a75 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 200 len: 1327 microversion: 2.1 time: 0.094362 Feb 12 04:25:41.658545 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 436/901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:41 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:25:42.677240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:42.677949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:42.684192 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:42.684631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:42.687968 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:42.687968 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:42.698510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. Feb 12 04:25:42.699078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:25:42.699877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3552ea88-b32f-4a84-946f-14ed4c0082a7 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 404 len: 111 microversion: 2.1 time: 0.027765 Feb 12 04:25:42.700391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 466/902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:42 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:42.708351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a5d511bd-3ea2-440a-bb9d-8de14be6eece tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '.version_select at 0x7f8e6838aa60>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:42.822371 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a5d511bd-3ea2-440a-bb9d-8de14be6eece tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247874361" status: 202 len: 0 microversion: 2.1 time: 0.117507 Feb 12 04:25:42.822876 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 437/903] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 04:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247874361 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:25:46.201168 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:46.201710 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:46.207928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:46.208378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:46.209149 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:46.209623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:46.222211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. Feb 12 04:25:46.222788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:25:46.224107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-45cb00ab-2f0a-4601-909a-2b9a0748b154 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 404 len: 111 microversion: 2.1 time: 0.026590 Feb 12 04:25:46.224617 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 467/904] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:25:46 2022] DELETE /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:46.232670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:46.233285 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: 749f3838-657b-45ae-8308-44f351782d53] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:46.392937 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:46.393419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:46.394223 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:46.394661 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:46.407489 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. Feb 12 04:25:46.408082 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance 749f3838-657b-45ae-8308-44f351782d53 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:25:46.408899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6b832626-588f-4e23-93e2-f82148d68594 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53" status: 404 len: 111 microversion: 2.1 time: 0.180347 Feb 12 04:25:46.409463 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 438/905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:46 2022] GET /compute/v2.1/servers/749f3838-657b-45ae-8308-44f351782d53 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:47.670206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:47.670693 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:47.677529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:47.677978 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:47.678747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:47.679181 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:47.692545 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. Feb 12 04:25:47.693166 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:25:47.693996 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2a883d00-1f64-491c-a973-0d3af4a81fc6 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 404 len: 111 microversion: 2.1 time: 0.027439 Feb 12 04:25:47.694513 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 468/906] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:25:47 2022] DELETE /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:47.702230 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:25:47.702881 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] [instance: b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:25:47.709057 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:47.709534 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:47.710293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:25:47.710723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:25:47.724202 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] HTTP exception thrown: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. Feb 12 04:25:47.724803 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] Returning 404 to user: Instance b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:25:47.725662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e6ef632e-ed14-456d-b3d2-6e2da9b6cd80 tempest-AttachVolumeTestJSON-603653507 tempest-AttachVolumeTestJSON-603653507-project] 10.222.0.31 "GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7" status: 404 len: 111 microversion: 2.1 time: 0.027010 Feb 12 04:25:47.726160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 439/907] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:25:47 2022] GET /compute/v2.1/servers/b9538ecc-7cb9-4b23-8d1e-02e7ccf90ae7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 04:26:01.812606 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:01.813749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:01.826663 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:01.827377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:01.828259 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:01.828816 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:01.858076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-db108652-e4a3-4f4f-ba03-89e99bdfe197 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049572 Feb 12 04:26:01.858634 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 469/908] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 04:26:01 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:01.916897 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:01.917433 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:01.924045 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:01.924496 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:01.925254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:01.925706 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:01.952057 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:26:02.261441 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bca6f480-81db-4293-91e5-787918df089a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 204 len: 0 microversion: 2.20 time: 0.347887 Feb 12 04:26:02.262008 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 440/909] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 04:26:01 2022] DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:26:02.270113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:02.272083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:02.277681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:02.278133 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:02.278919 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:02.279357 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:02.417134 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:02.425005 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:02.426533 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:02.427726 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-87624c9a-68e4-4b64-af3a-4750fae4f6ce tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.161416 Feb 12 04:26:02.428272 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 470/910] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:02 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:26:03.447188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:03.447873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:03.454221 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:03.455612 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:03.456593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:03.457049 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:03.601190 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:03.610986 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:03.614455 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:03.615160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a3fe2cc4-1bba-4585-9883-56494d234a68 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1722 microversion: 2.20 time: 0.172632 Feb 12 04:26:03.616525 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 441/911] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:03 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:26:04.643003 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:04.643626 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:04.651118 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:04.651578 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:04.652378 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:04.652820 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:04.692820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-163f5d0e-d509-4dbc-aeda-59a32af309d7 req-4e4bce4d-370f-431c-9ced-f8c2edb1676b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e28932f-789d-4692-aabf-13afc5f49e67", "name": "network-vif-deleted", "tag": "f422b7da-a2b0-42ea-ae30-eab3ad40c55e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:04.692820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:26:04.692820 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:26:04.704243 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-163f5d0e-d509-4dbc-aeda-59a32af309d7 req-4e4bce4d-370f-431c-9ced-f8c2edb1676b service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:04.704689 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-163f5d0e-d509-4dbc-aeda-59a32af309d7 req-4e4bce4d-370f-431c-9ced-f8c2edb1676b service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:04.723104 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-163f5d0e-d509-4dbc-aeda-59a32af309d7 req-4e4bce4d-370f-431c-9ced-f8c2edb1676b service nova] Creating event network-vif-deleted:f422b7da-a2b0-42ea-ae30-eab3ad40c55e for instance 5e28932f-789d-4692-aabf-13afc5f49e67 on hv-cinder-82869 Feb 12 04:26:04.730258 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-163f5d0e-d509-4dbc-aeda-59a32af309d7 req-4e4bce4d-370f-431c-9ced-f8c2edb1676b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045058 Feb 12 04:26:04.730922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 442/912] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:26:04.737813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:04.747929 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:04.761673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86560704b2374f75bc32b19475b63462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a7d98ea94e4547983dbffcb2b614bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:04.761673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2af60586-3578-46e7-a05f-1b393ee1beaa tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 200 len: 1654 microversion: 2.20 time: 0.116738 Feb 12 04:26:04.761673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 471/913] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:04 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 1654 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 04:26:05.768874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:05.769607 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:05.775578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:05.776022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:05.776786 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:05.777251 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:05.790275 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. Feb 12 04:26:05.790851 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:26:05.791645 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2fc64bbb-1d06-498b-8902-df6974e22f78 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 404 len: 111 microversion: 2.20 time: 0.027380 Feb 12 04:26:05.792157 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 443/914] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:05 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:26:05.800278 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-309d7dbf-0eb1-4483-a8c3-4f4525b90cad tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '.version_select at 0x7f8e6844f550>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:05.895373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-309d7dbf-0eb1-4483-a8c3-4f4525b90cad tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163355894" status: 204 len: 0 microversion: 2.20 time: 0.098589 Feb 12 04:26:05.901498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 472/915] 10.222.0.31 () {60 vars in 1258 bytes} [Sat Feb 12 04:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163355894 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 04:26:07.923080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:07.923644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:07.930633 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:07.930925 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:07.931690 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:07.932119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:07.944813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. Feb 12 04:26:07.945405 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:26:07.946195 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0b77ad29-67b8-4e5b-8d4a-7255b72e0548 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 404 len: 111 microversion: 2.20 time: 0.026770 Feb 12 04:26:07.946697 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 444/916] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 04:26:07 2022] DELETE /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:26:07.955171 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:07.955785 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5e28932f-789d-4692-aabf-13afc5f49e67] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:07.962501 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:07.962949 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:07.963798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:07.964218 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:07.980226 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. Feb 12 04:26:07.980814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5e28932f-789d-4692-aabf-13afc5f49e67 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:26:07.981691 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e164a6ca-7952-457d-9d0f-1e81c38a6b3a tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67" status: 404 len: 111 microversion: 2.20 time: 0.030907 Feb 12 04:26:07.982228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 473/917] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:07 2022] GET /compute/v2.1/servers/5e28932f-789d-4692-aabf-13afc5f49e67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:26:09.258006 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:09.258515 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:09.264271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:09.264710 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:09.265576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:09.266002 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:09.278949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. Feb 12 04:26:09.279528 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:26:09.280343 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-65ef497d-13fb-4db4-8c15-91796f5998eb tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 404 len: 111 microversion: 2.20 time: 0.026654 Feb 12 04:26:09.281108 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 445/918] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 04:26:09 2022] DELETE /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 04:26:09.288618 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:09.289228 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] [instance: 5d27a38f-f79b-4a12-8dd1-e520acda4662] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:09.295124 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:09.295567 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:09.296325 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:09.296758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:09.309832 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] HTTP exception thrown: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. Feb 12 04:26:09.310405 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] Returning 404 to user: Instance 5d27a38f-f79b-4a12-8dd1-e520acda4662 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:26:09.311196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1cf24429-0efe-4080-84f3-9b1a6623a1f8 tempest-AttachVolumeShelveTestJSON-2096549792 tempest-AttachVolumeShelveTestJSON-2096549792-project] 10.222.0.31 "GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662" status: 404 len: 111 microversion: 2.20 time: 0.026299 Feb 12 04:26:09.311704 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 474/919] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 04:26:09 2022] GET /compute/v2.1/servers/5d27a38f-f79b-4a12-8dd1-e520acda4662 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 04:26:14.737494 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:14.738022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:14.744816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:14.745257 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:14.746078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:14.746506 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:14.772026 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lazy-loading 'flavor' on Instance uuid 69e1a591-62ac-44cc-a194-fd476f478672 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:26:15.046697 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-df304547-f28b-4138-89d1-b9ebe5762efa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "POST /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672/action" status: 202 len: 0 microversion: 2.1 time: 0.312806 Feb 12 04:26:15.047280 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 446/920] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:26:14 2022] POST /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:26:15.056908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:15.058773 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:15.064685 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:15.065129 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:15.065931 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:15.066359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:15.204041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:15.211499 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a5c999e8-9dbe-44d3-b2fe-f43fdbe7fb51 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.158465 Feb 12 04:26:15.212050 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 475/921] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:15 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:26:16.228170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:16.228855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:16.235499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:16.236864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:16.236864 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:16.237334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:16.383404 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:16.390598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-b196bbc6-1ee1-4a67-ad6b-d7e09dac9107 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.166482 Feb 12 04:26:16.391664 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 447/922] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:16 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:17.407692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:17.408300 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:17.414627 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:17.415071 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:17.415844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:17.416277 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:17.550448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:17.558549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4ef30c5f-c8e6-49af-86fd-d32a78e721aa tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.154523 Feb 12 04:26:17.559117 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 476/923] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:17 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:18.575265 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:18.575915 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:18.582210 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:18.582647 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:18.583410 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:18.584407 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:18.716139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:18.723348 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-34d71b1b-b75a-4d10-83ef-cabd3cf371e5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.152057 Feb 12 04:26:18.723907 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 448/924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:18 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:19.740116 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:19.740731 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:19.746689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:19.747138 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:19.747914 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:19.748347 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:19.882041 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:19.893035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-178da717-6867-409b-a536-13013e22913d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.152950 Feb 12 04:26:19.893035 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 477/925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:19 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:20.906662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:20.907293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:20.913558 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:20.914080 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:20.914913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:20.915411 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:21.048272 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:21.056047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0e3da451-ed33-4803-a4bb-3403e1232214 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.153100 Feb 12 04:26:21.056596 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 449/926] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:20 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:22.072694 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:22.073328 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:22.079567 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:22.080024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:22.080796 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:22.081234 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:22.210988 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:22.218207 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b2144ae8-849c-4174-ac77-d5602c2e6011 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.149153 Feb 12 04:26:22.218768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 478/927] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:22 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:23.235767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:23.236821 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:23.243973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:23.244418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:23.245198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:23.245665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:23.396882 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:23.404390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-622f348b-42cd-4f39-9366-003bcf97e5e0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.173955 Feb 12 04:26:23.407134 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 450/928] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:23 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:24.422380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:24.422987 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:24.430262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:24.432624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:24.432624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:24.432624 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:24.563267 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:24.570612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-080575cb-9eb2-4aca-88bb-f0270ecd03cb tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.151932 Feb 12 04:26:24.571163 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 479/929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:24 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:25.587580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:25.588192 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:25.594382 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:25.594832 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:25.595789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:25.596036 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:25.796741 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:25.804574 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-414ddc96-f34f-484f-ac98-f1eebcdfdc4a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.220747 Feb 12 04:26:25.812238 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 451/930] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:25 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:26.821470 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:26.822078 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:26.828245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:26.828689 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:26.829487 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:26.829926 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:26.999892 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:27.007359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-9891d2dc-503a-4469-86e9-7724333ce673 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.189543 Feb 12 04:26:27.007864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 480/931] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:26 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:26:28.023742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:28.024385 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:28.030798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:28.031252 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:28.032062 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:28.032502 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:28.251763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:28.261530 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e99c4571-8acd-42b7-a3d9-f2bfd2a802e3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.241347 Feb 12 04:26:28.262094 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 452/932] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:28 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:29.278313 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:29.278992 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:29.285095 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:29.285571 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:29.286352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:29.286833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:29.429483 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:29.437358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-07235ecf-08ea-4bd0-b469-ddc96cf8c1f5 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.162744 Feb 12 04:26:29.437924 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 481/933] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:29 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:30.454523 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:30.455133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:30.462708 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:30.463160 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:30.463987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:30.464418 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:30.606606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:30.614386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a0c45efc-0a91-4e9b-a1f5-097f712fe254 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.164288 Feb 12 04:26:30.614944 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 453/934] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:30 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:31.631170 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:31.631969 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:31.638246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:31.638908 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:31.639856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:31.640287 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:31.796495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:31.804042 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-90f4b39f-e2b2-4f6e-8320-03db860d01a8 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1569 microversion: 2.1 time: 0.176577 Feb 12 04:26:31.804612 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 482/935] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:31 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:31.820285 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:31.820867 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:31.827178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:31.827626 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:31.828409 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:31.828845 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:32.094592 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f5597a50-09a5-4533-b832-8a9a9c4d25b0 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "POST /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672/action" status: 202 len: 0 microversion: 2.1 time: 0.278203 Feb 12 04:26:32.098181 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 454/936] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 04:26:31 2022] POST /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:26:32.103058 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:32.103665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:32.110535 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:32.110979 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:32.111907 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:32.112567 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:32.249625 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:32.257571 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fb0907da-9fab-4673-a027-f6c8cdf2d7bc tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1517 microversion: 2.1 time: 0.158116 Feb 12 04:26:32.258136 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 483/937] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:32 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:33.275681 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:33.276293 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:33.282217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:33.282884 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:33.283698 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:33.284132 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:33.435425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:33.442759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-12b8a13c-8da1-4c17-9886-8add41176133 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1519 microversion: 2.1 time: 0.172382 Feb 12 04:26:33.443840 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 455/938] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:33 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:34.463239 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:34.463239 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:34.468058 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:34.468512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:34.469525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:34.470346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:34.608081 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:34.615633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4db212ad-f29f-4287-a4fe-422325aebd48 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1519 microversion: 2.1 time: 0.159202 Feb 12 04:26:34.616191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 484/939] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:34 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:34.932750 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-4fc95b97-375e-4d4d-9017-247608cc55ed req-e54b891c-22f9-4ac3-ab2a-77686640324a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "name": "network-vif-unplugged", "status": "completed", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:34.936284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:26:34.936284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:26:34.943971 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-4fc95b97-375e-4d4d-9017-247608cc55ed req-e54b891c-22f9-4ac3-ab2a-77686640324a service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:34.944332 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-4fc95b97-375e-4d4d-9017-247608cc55ed req-e54b891c-22f9-4ac3-ab2a-77686640324a service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:34.955675 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-4fc95b97-375e-4d4d-9017-247608cc55ed req-e54b891c-22f9-4ac3-ab2a-77686640324a service nova] Creating event network-vif-unplugged:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:26:34.961229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-4fc95b97-375e-4d4d-9017-247608cc55ed req-e54b891c-22f9-4ac3-ab2a-77686640324a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032427 Feb 12 04:26:34.961839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 456/940] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:26:35.631776 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:35.632427 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:35.638662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:35.639111 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:35.639902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:35.640339 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:35.832873 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:35.840544 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-678b20c2-a5fa-4437-8c46-332dabcc34a3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.212408 Feb 12 04:26:35.841114 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 485/941] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:35 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:36.858661 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:36.859359 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:36.865619 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:36.866078 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:36.866872 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:36.867308 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:37.000660 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:37.008641 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-67eb195d-bab6-494f-a1ee-c68f5a95ccd3 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.154446 Feb 12 04:26:37.009203 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 457/942] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:36 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:38.025541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:38.026143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:38.032433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:38.032876 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:38.033668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:38.034098 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:38.163407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:38.170917 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2a62d3fd-4353-4ec0-933a-83644aec4c38 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.149559 Feb 12 04:26:38.171478 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 486/943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:38 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:39.186732 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:39.187346 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:39.193186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:39.193663 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:39.194443 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:39.194877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:39.329168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:39.337169 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9dc918a6-4805-4fbc-ae4f-a1c7d8ebf42e tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.154251 Feb 12 04:26:39.337752 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 458/944] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:39 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:40.354775 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:40.355436 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:40.361397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:40.361928 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:40.362674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:40.363103 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:40.494027 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:40.501172 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-bc46d2d4-b61d-4dc3-a9ed-7fa535a3fe76 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.151042 Feb 12 04:26:40.501753 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 487/945] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:40 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:41.517890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:41.518531 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:41.525161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:41.525635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:41.526406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:41.526841 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:41.910177 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:41.917582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-15295961-a44a-43f2-a99d-a53d114da00a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.403437 Feb 12 04:26:41.918148 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 459/946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:41 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:42.934046 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:42.934653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:42.940835 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:42.941301 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:42.942086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:42.942543 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:43.075214 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:43.082542 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8b125ef5-7115-451a-b726-d4569cb76c14 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.152210 Feb 12 04:26:43.083107 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 488/947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:42 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:44.100069 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:44.100817 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:44.107618 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:44.108067 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:44.108874 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:44.109335 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:44.277916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:44.286419 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-bb1271e9-4486-4f15-8bb4-f7d3532789a7 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.189647 Feb 12 04:26:44.286770 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 460/948] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:44 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:45.302692 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:45.303393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:45.310219 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:45.310671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:45.311442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:45.311882 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:45.449167 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:45.456527 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-088fa47c-fee1-410f-bc17-9527e59bc559 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.157493 Feb 12 04:26:45.457089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 489/949] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:45 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:46.473839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:46.474482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:46.481269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:46.487024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:46.487024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:46.487024 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:46.619412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:46.626646 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a6fc3eba-37f6-461e-844c-70c08eab3c5d tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.156443 Feb 12 04:26:46.627240 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 461/950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:46 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:47.239617 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-83dddb57-8814-4828-96c5-f7d6fd670fe6 req-81ecfe34-b0ec-4e45-a9ff-2539885bca91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "name": "network-vif-plugged", "status": "completed", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:47.241864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:26:47.241864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:26:47.251010 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-83dddb57-8814-4828-96c5-f7d6fd670fe6 req-81ecfe34-b0ec-4e45-a9ff-2539885bca91 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:47.251558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-83dddb57-8814-4828-96c5-f7d6fd670fe6 req-81ecfe34-b0ec-4e45-a9ff-2539885bca91 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:47.263240 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-83dddb57-8814-4828-96c5-f7d6fd670fe6 req-81ecfe34-b0ec-4e45-a9ff-2539885bca91 service nova] Creating event network-vif-plugged:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:26:47.268346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-83dddb57-8814-4828-96c5-f7d6fd670fe6 req-81ecfe34-b0ec-4e45-a9ff-2539885bca91 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032882 Feb 12 04:26:47.268941 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 490/951] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:26:47.643000 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:47.643613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:47.649938 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:47.650386 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:47.651162 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:47.651595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:47.950494 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:47.961527 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3430d87f-50ea-45b0-b014-07ae11a7059c tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1575 microversion: 2.1 time: 0.321608 Feb 12 04:26:47.970985 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 462/952] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:47 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1575 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:48.979377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:26:48.980206 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:26:48.992993 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:48.996196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:48.997200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:26:48.998649 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:26:49.200246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:26:49.207837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e4179c75-04a3-4f58-90aa-c66de917b9d6 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1562 microversion: 2.1 time: 0.233026 Feb 12 04:26:49.208432 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 491/953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:26:48 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:26:58.397041 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Action: 'create', calling method: .version_select at 0x7f8e6838adc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2112910915"}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:26:58.411585 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:26:58.416135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for user cfe451f65ec449499a947853f550e08a and project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:26:58.819533 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:26:58.824083 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for user cfe451f65ec449499a947853f550e08a and project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'key_pairs'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:26:58.839799 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a3f08f15-229d-47c6-a0eb-201fdd2d6797 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.644025 Feb 12 04:26:58.840578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 463/954] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 04:26:58 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:16.805247 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:27:16.805782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:27:24.166082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1874203443", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2112910915", "security_groups": [{"name": "tempest-secgroup-smoke-1955171707"}], "block_device_mapping_v2": [{"uuid": "3909722c-182d-4aec-9ece-6252aefaaff4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f30c43-2deb-4a40-8f2e-dea98a37ce35"}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:24.272564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] validate_networks() for [('73f30c43-2deb-4a40-8f2e-dea98a37ce35', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:27:24.636147 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:27:24.636563 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:27:24.637687 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:27:24.638090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:27:24.638492 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:27:24.646964 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:24.647407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:24.648227 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:24.648654 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:24.664173 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:27:24.668019 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for user cfe451f65ec449499a947853f550e08a and project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:27:24.722874 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:27:24.723771 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3909722c-182d-4aec-9ece-6252aefaaff4',volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:27:25.170953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3abe4572-7f9c-43c2-9fd0-9942ae1cbbfd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008535 Feb 12 04:27:25.194297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 492/955] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:27:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:27:25.195474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-3ba4e166-25e4-432e-a087-c4d8e73fea55 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:25.195474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-3ba4e166-25e4-432e-a087-c4d8e73fea55 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:25.245791 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-3ba4e166-25e4-432e-a087-c4d8e73fea55 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:25.252886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-3ba4e166-25e4-432e-a087-c4d8e73fea55 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1095 microversion: 2.1 time: 0.074983 Feb 12 04:27:25.253684 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 464/956] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:25 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:26.270352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-898940e7-bb26-44b6-833e-e0cae12c92bb tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:26.270965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-898940e7-bb26-44b6-833e-e0cae12c92bb tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:26.327844 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-898940e7-bb26-44b6-833e-e0cae12c92bb tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:26.334256 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-898940e7-bb26-44b6-833e-e0cae12c92bb tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1095 microversion: 2.1 time: 0.068424 Feb 12 04:27:26.334783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 493/957] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:26 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:27.350342 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:27.350944 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:27.357152 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:27.360676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:27.360676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:27.360676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:27.421398 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:27.429083 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8b53dd56-df13-4f94-ae0f-02f3b048b1e0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1193 microversion: 2.1 time: 0.082289 Feb 12 04:27:27.431758 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 465/958] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:27 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:28.446113 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:28.446724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:28.453097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:28.453564 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:28.454340 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:28.454774 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:28.592169 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:28.599424 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d13531f6-a802-48f3-aeef-42476e835639 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1279 microversion: 2.1 time: 0.157000 Feb 12 04:27:28.599974 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 494/959] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:28 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:29.615952 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:29.616608 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:29.623861 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:29.624314 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:29.625167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:29.626300 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:29.829587 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:29.836817 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f71ecffb-3645-4d97-a902-a022eda84ad7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1279 microversion: 2.1 time: 0.224509 Feb 12 04:27:29.837383 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 466/960] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:29 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:30.475683 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-a9c46063-7e76-4907-bd6f-ccb624e40a2a req-cb391ccd-a0ab-4941-814b-aae933d688d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198199d7-484a-4902-a98d-a9f3a79cfa95", "tag": "920df1a9-8872-4cc9-9d62-d0101c526425"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:30.477473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:30.477473 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:27:30.484754 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-a9c46063-7e76-4907-bd6f-ccb624e40a2a req-cb391ccd-a0ab-4941-814b-aae933d688d2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:30.485559 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-a9c46063-7e76-4907-bd6f-ccb624e40a2a req-cb391ccd-a0ab-4941-814b-aae933d688d2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:30.498794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-a9c46063-7e76-4907-bd6f-ccb624e40a2a req-cb391ccd-a0ab-4941-814b-aae933d688d2 service nova] Creating event network-changed:920df1a9-8872-4cc9-9d62-d0101c526425 for instance 198199d7-484a-4902-a98d-a9f3a79cfa95 on hv-cinder-82869 Feb 12 04:27:30.503976 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-a9c46063-7e76-4907-bd6f-ccb624e40a2a req-cb391ccd-a0ab-4941-814b-aae933d688d2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031978 Feb 12 04:27:30.504576 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 495/961] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:30.853891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:30.854538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:30.860670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:30.861415 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:30.862190 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:30.862622 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:31.031950 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:31.039478 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d142b94e-d05d-49b7-a29c-8e6ade202e21 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1279 microversion: 2.1 time: 0.189353 Feb 12 04:27:31.040123 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 467/962] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:30 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:32.057313 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:32.057967 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:32.064890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:32.065381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:32.066160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:32.066596 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:32.203007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:32.210235 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-aa60aab0-eeec-412a-92ab-9d1ccc5ae3fa tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.157160 Feb 12 04:27:32.210805 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 496/963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:32 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:33.228486 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:33.229098 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:33.236533 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:33.236917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:33.237731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:33.238162 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:33.369935 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:33.377182 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c5dea9b0-69cc-47fd-90c0-9108721acbb4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.152537 Feb 12 04:27:33.377756 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 468/964] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:33 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:34.393572 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:34.394200 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:34.402249 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:34.402702 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:34.403511 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:34.404526 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:34.547749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:34.555081 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2e0385ce-b32d-4e82-a840-28a693f39490 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.165303 Feb 12 04:27:34.555655 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 497/965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:34 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:35.571296 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:35.571943 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:35.578125 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:35.585074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:35.585074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:35.585074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:35.717542 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:35.724917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-87d3802c-1aab-4eee-a2ef-7877c99fdcf9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.157222 Feb 12 04:27:35.725923 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 469/966] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:35 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:36.745400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:36.746019 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:36.752864 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:36.753402 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:36.754186 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:36.754673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:36.886429 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:36.897510 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ba52a773-7c44-4c80-a8f6-8af7b2290050 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.155867 Feb 12 04:27:36.898087 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 498/967] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:36 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:37.913261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:37.913929 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:37.920446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:37.920911 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:37.921723 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:37.922162 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:38.110775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:38.118246 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d6867d79-65f4-4dd3-b8ac-186eaca029f6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.208750 Feb 12 04:27:38.118811 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 470/968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:37 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:39.135443 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:39.136055 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:39.142275 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:39.142729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:39.143508 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:39.143947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:39.279837 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:39.288325 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b4b5daba-dc9e-456d-99ea-0cd4e429cf4b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.156664 Feb 12 04:27:39.288895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 499/969] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:39 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:40.305119 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:40.305779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:40.311593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:40.312042 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:40.312816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:40.313246 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:40.441938 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:40.449174 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-9505c34f-d846-4510-a8b2-b3bce87d8dc5 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.147864 Feb 12 04:27:40.449753 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 471/970] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:40 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:41.000712 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1715002840", "imageRef": "5a151532-db32-4082-a4a4-ca1a063bf516", "flavorRef": "452"}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:41.050401 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] validate_networks() for None {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:27:41.329464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:27:41.329895 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:27:41.330370 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:27:41.330782 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:27:41.331199 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:27:41.339679 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:41.340135 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:41.340954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:41.341416 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:41.358054 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Getting quotas for project 5863100afb0b4ebb855a9acf332162b6. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:27:41.362970 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Getting quotas for user 6c0709b6a5ee494f889ce149ccc9579c and project 5863100afb0b4ebb855a9acf332162b6. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:27:41.373730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:27:41.379541 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a151532-db32-4082-a4a4-ca1a063bf516',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:27:41.465581 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:41.466194 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:41.472803 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:41.473254 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:41.474089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:41.474541 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:41.574291 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-15de7107-5fae-4631-a880-38980106ce59 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577777 Feb 12 04:27:41.574975 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 500/971] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:27:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:27:41.585854 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4ec059fe-9399-44d6-98f1-398ea871bccc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:41.586523 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4ec059fe-9399-44d6-98f1-398ea871bccc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:41.612927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:41.620876 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-65ec344c-1b95-42d4-a007-ccf2063c7020 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.159003 Feb 12 04:27:41.621474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 472/972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:41 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:27:41.659406 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4ec059fe-9399-44d6-98f1-398ea871bccc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:41.665863 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4ec059fe-9399-44d6-98f1-398ea871bccc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1215 microversion: 2.1 time: 0.084299 Feb 12 04:27:41.666431 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 501/973] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:41 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:27:42.637617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:42.638166 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:42.645262 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:42.645761 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:42.646565 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:42.647004 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:42.683966 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3f22b5be-80e8-4210-8f15-a5b9226032d6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:42.684549 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3f22b5be-80e8-4210-8f15-a5b9226032d6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:42.740621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3f22b5be-80e8-4210-8f15-a5b9226032d6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:42.748261 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3f22b5be-80e8-4210-8f15-a5b9226032d6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1215 microversion: 2.1 time: 0.068929 Feb 12 04:27:42.749494 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 502/974] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:42 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:27:42.804726 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:42.813349 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-f80f1d82-15b4-4473-9ab8-0efacca1ea1f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.179487 Feb 12 04:27:42.813902 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 473/975] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:42 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:42.910265 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-5e5e0118-473c-46fb-9259-ce4fed6186de req-3729fb15-9d2c-4336-8e9e-f68b19131849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198199d7-484a-4902-a98d-a9f3a79cfa95", "name": "network-vif-plugged", "status": "completed", "tag": "920df1a9-8872-4cc9-9d62-d0101c526425"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:42.911858 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:42.911858 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:27:42.921089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-5e5e0118-473c-46fb-9259-ce4fed6186de req-3729fb15-9d2c-4336-8e9e-f68b19131849 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:42.921557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-5e5e0118-473c-46fb-9259-ce4fed6186de req-3729fb15-9d2c-4336-8e9e-f68b19131849 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:42.931279 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-5e5e0118-473c-46fb-9259-ce4fed6186de req-3729fb15-9d2c-4336-8e9e-f68b19131849 service nova] Creating event network-vif-plugged:920df1a9-8872-4cc9-9d62-d0101c526425 for instance 198199d7-484a-4902-a98d-a9f3a79cfa95 on hv-cinder-82869 Feb 12 04:27:42.937187 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-5e5e0118-473c-46fb-9259-ce4fed6186de req-3729fb15-9d2c-4336-8e9e-f68b19131849 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029889 Feb 12 04:27:42.938093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 503/976] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:43.765742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:43.766351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:43.772578 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:43.773025 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:43.773870 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:43.774303 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:43.829826 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:43.830651 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:43.835803 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:43.838893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:43.838893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:43.839098 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:43.839380 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:43.843696 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-56f47998-ca41-466c-b6ee-601f76dd1aba tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1267 microversion: 2.1 time: 0.082287 Feb 12 04:27:43.844446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 474/977] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:43 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:43.970903 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:43.978132 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e70a2758-445b-4da1-ad1c-ed3227c33302 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1267 microversion: 2.1 time: 0.152858 Feb 12 04:27:43.978690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 504/978] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:43 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:44.860395 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:44.861009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:44.867969 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:44.868421 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:44.869204 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:44.869666 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:44.936432 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:44.943877 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d99d842a-3cde-4e79-a678-fa7cb9c23644 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1273 microversion: 2.1 time: 0.087759 Feb 12 04:27:44.944455 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 475/979] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:44 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:44.995154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:44.995772 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:45.002217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.002671 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:45.003462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.003896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:45.222184 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:45.230143 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8e7da1db-1283-4717-965d-c351f6c70840 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1454 microversion: 2.1 time: 0.238791 Feb 12 04:27:45.230887 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 505/980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:44 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:45.246606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:45.247261 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:45.253556 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.259800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:45.259800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.259800 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:45.458838 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:45.466274 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-39031ba9-6333-46bd-bb21-5be6f532e5db tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1454 microversion: 2.1 time: 0.223495 Feb 12 04:27:45.466954 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 476/981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:45 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:45.959840 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:45.966814 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:45.967788 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.968246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:45.969033 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:45.969719 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:46.164813 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:46.172522 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-19055d25-a119-4a9e-855f-c64bb0947fc3 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.216454 Feb 12 04:27:46.173075 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 506/982] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:45 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:46.229131 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-c31e4f71-2ea0-4be1-9bad-491ed4cbe945 req-39af611a-26bb-4fce-9ccf-11b5a4accf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede4b820-6e64-448b-a2d6-8418cf6d5437", "tag": "667199df-8c20-4e1e-9297-597c20bf819e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:46.230721 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:46.230721 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:27:46.238797 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-c31e4f71-2ea0-4be1-9bad-491ed4cbe945 req-39af611a-26bb-4fce-9ccf-11b5a4accf69 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:46.239229 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-c31e4f71-2ea0-4be1-9bad-491ed4cbe945 req-39af611a-26bb-4fce-9ccf-11b5a4accf69 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:46.260196 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-c31e4f71-2ea0-4be1-9bad-491ed4cbe945 req-39af611a-26bb-4fce-9ccf-11b5a4accf69 service nova] Creating event network-changed:667199df-8c20-4e1e-9297-597c20bf819e for instance ede4b820-6e64-448b-a2d6-8418cf6d5437 on hv-cinder-82869 Feb 12 04:27:46.269827 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-c31e4f71-2ea0-4be1-9bad-491ed4cbe945 req-39af611a-26bb-4fce-9ccf-11b5a4accf69 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044102 Feb 12 04:27:46.270428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 477/983] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:47.189462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:47.190073 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:47.196277 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:47.196724 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:47.197525 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:47.197962 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:47.335529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:47.342953 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-6b3f62db-09c4-49e5-aa14-eab86d039851 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.157675 Feb 12 04:27:47.343498 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 507/984] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:47 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:47.923703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-e7f22129-c696-447a-9410-17c3dfb457f6 req-8c807088-fd81-4362-8710-f25eaecbdfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198199d7-484a-4902-a98d-a9f3a79cfa95", "tag": "920df1a9-8872-4cc9-9d62-d0101c526425"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:47.925271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:47.925271 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:27:47.932315 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-e7f22129-c696-447a-9410-17c3dfb457f6 req-8c807088-fd81-4362-8710-f25eaecbdfe6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:47.932752 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-e7f22129-c696-447a-9410-17c3dfb457f6 req-8c807088-fd81-4362-8710-f25eaecbdfe6 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:47.943853 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-e7f22129-c696-447a-9410-17c3dfb457f6 req-8c807088-fd81-4362-8710-f25eaecbdfe6 service nova] Creating event network-changed:920df1a9-8872-4cc9-9d62-d0101c526425 for instance 198199d7-484a-4902-a98d-a9f3a79cfa95 on hv-cinder-82869 Feb 12 04:27:47.948598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-e7f22129-c696-447a-9410-17c3dfb457f6 req-8c807088-fd81-4362-8710-f25eaecbdfe6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029962 Feb 12 04:27:47.949256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 478/985] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:48.360357 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:48.360970 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:48.367460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:48.367904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:48.368675 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:48.369109 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:48.558730 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:48.566694 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a3f5659a-4b2f-4af5-ba34-579fdbb6dafc tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.211020 Feb 12 04:27:48.567263 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 508/986] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:48 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:49.584329 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:49.585126 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:49.597899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:49.597899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:49.597899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:49.597899 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:49.724131 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:49.731360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5e8c9627-0c61-44e3-974f-bd47c587f3c6 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.151500 Feb 12 04:27:49.731913 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 479/987] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:49 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:50.747718 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:50.748359 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:50.755285 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:50.755736 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:50.756512 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:50.756947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:50.889112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:50.894685 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-b5a06218-7c52-4f3e-8168-4bdcb0fedb09 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.150654 Feb 12 04:27:50.895248 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 509/988] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:50 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:50.975047 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-11bbbe64-e951-4e5d-947d-0109fe669dd8 req-1e93d6c2-1ef1-4b23-b835-2aded4e769df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede4b820-6e64-448b-a2d6-8418cf6d5437", "name": "network-vif-plugged", "status": "completed", "tag": "667199df-8c20-4e1e-9297-597c20bf819e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:50.976562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:50.976562 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:27:50.984449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-11bbbe64-e951-4e5d-947d-0109fe669dd8 req-1e93d6c2-1ef1-4b23-b835-2aded4e769df service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:50.984891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-11bbbe64-e951-4e5d-947d-0109fe669dd8 req-1e93d6c2-1ef1-4b23-b835-2aded4e769df service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:50.995440 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-11bbbe64-e951-4e5d-947d-0109fe669dd8 req-1e93d6c2-1ef1-4b23-b835-2aded4e769df service nova] Creating event network-vif-plugged:667199df-8c20-4e1e-9297-597c20bf819e for instance ede4b820-6e64-448b-a2d6-8418cf6d5437 on hv-cinder-82869 Feb 12 04:27:51.003603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-11bbbe64-e951-4e5d-947d-0109fe669dd8 req-1e93d6c2-1ef1-4b23-b835-2aded4e769df service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028895 Feb 12 04:27:51.003603 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 480/989] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:51.911338 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:51.911944 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:51.918243 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:51.918695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:51.919464 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:51.919899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:52.048819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:52.056029 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-783c3813-0659-466e-bce5-55719e85519b tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1315 microversion: 2.1 time: 0.148359 Feb 12 04:27:52.056590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 510/990] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:51 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:53.072673 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:53.073399 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:53.079693 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.080140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.080916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.081388 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.211553 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:53.219316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-8a21d397-d6d8-46f3-a39f-e9a710c4fe04 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1465 microversion: 2.1 time: 0.151097 Feb 12 04:27:53.219869 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 481/991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:53 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:53.255623 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:53.256112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:53.262274 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.262721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.263529 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.263960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.289809 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:27:53.533653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1386f417-dfa5-4e63-9259-992047a2bbeb tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 204 len: 0 microversion: 2.1 time: 0.281176 Feb 12 04:27:53.534162 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 511/992] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:27:53 2022] DELETE /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:27:53.544408 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:53.545249 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:53.551576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.552022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.552789 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:53.553217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:53.686929 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:53.694220 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-27c7bf20-fbbe-4b82-86ad-94ac8d0f8c5d tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1471 microversion: 2.1 time: 0.154434 Feb 12 04:27:53.694766 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 482/993] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:53 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:27:54.712381 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:54.713102 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:54.719960 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:54.720408 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:54.721185 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:54.721646 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:54.864358 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:54.871684 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0f8810d5-4196-4ade-aa17-98c41b84c905 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1471 microversion: 2.1 time: 0.163373 Feb 12 04:27:54.872246 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 512/994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:54 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:55.483936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-5f4f0242-69a8-412c-89e3-d186d56a1104 req-c391e653-a77a-41ce-932c-cbe2ff548833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede4b820-6e64-448b-a2d6-8418cf6d5437", "name": "network-vif-deleted", "tag": "667199df-8c20-4e1e-9297-597c20bf819e"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:27:55.483936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:27:55.483936 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:27:55.490755 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-5f4f0242-69a8-412c-89e3-d186d56a1104 req-c391e653-a77a-41ce-932c-cbe2ff548833 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:55.491193 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-5f4f0242-69a8-412c-89e3-d186d56a1104 req-c391e653-a77a-41ce-932c-cbe2ff548833 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:55.503221 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-5f4f0242-69a8-412c-89e3-d186d56a1104 req-c391e653-a77a-41ce-932c-cbe2ff548833 service nova] Creating event network-vif-deleted:667199df-8c20-4e1e-9297-597c20bf819e for instance ede4b820-6e64-448b-a2d6-8418cf6d5437 on hv-cinder-82869 Feb 12 04:27:55.510433 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-5f4f0242-69a8-412c-89e3-d186d56a1104 req-c391e653-a77a-41ce-932c-cbe2ff548833 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Feb 12 04:27:55.520498 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 483/995] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:27:55.888665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:55.889217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:55.896139 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:55.896589 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:55.897417 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:55.897854 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:55.927012 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:55.927455 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:55.927904 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.objects.instance [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lazy-loading 'fault' on Instance uuid ede4b820-6e64-448b-a2d6-8418cf6d5437 {{(pid=116751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:27:55.966096 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0709b6a5ee494f889ce149ccc9579c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5863100afb0b4ebb855a9acf332162b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:27:55.974003 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ed4cb5d3-dbe9-4542-8a2c-ebdb0ceccb05 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 200 len: 1305 microversion: 2.1 time: 0.089173 Feb 12 04:27:55.974566 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 513/996] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:55 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:27:56.992083 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:27:56.992784 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] [instance: ede4b820-6e64-448b-a2d6-8418cf6d5437] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:27:56.998798 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:56.999250 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:57.000033 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:27:57.000471 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:27:57.013257 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] HTTP exception thrown: Instance ede4b820-6e64-448b-a2d6-8418cf6d5437 could not be found. Feb 12 04:27:57.019173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] Returning 404 to user: Instance ede4b820-6e64-448b-a2d6-8418cf6d5437 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:27:57.019173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-d35fdf6f-f4fa-4fe2-8a29-f92d110321c1 tempest-VolumesNegativeTest-573897746 tempest-VolumesNegativeTest-573897746-project] 10.222.0.31 "GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437" status: 404 len: 111 microversion: 2.1 time: 0.027326 Feb 12 04:27:57.019173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 484/997] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:27:56 2022] GET /compute/v2.1/servers/ede4b820-6e64-448b-a2d6-8418cf6d5437 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:28:18.071245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:18.071744 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:28:18.074017 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-b7e0a7e9-ac6c-46b8-abc8-3694261df43f req-2be4e162-2971-47b1-b74a-7360adf3d34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:28:18.075568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:28:18.075568 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:28:18.078295 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:18.079460 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:18.080480 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:18.080921 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:18.083312 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-b7e0a7e9-ac6c-46b8-abc8-3694261df43f req-2be4e162-2971-47b1-b74a-7360adf3d34e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:18.083984 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-b7e0a7e9-ac6c-46b8-abc8-3694261df43f req-2be4e162-2971-47b1-b74a-7360adf3d34e service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:18.094855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-b7e0a7e9-ac6c-46b8-abc8-3694261df43f req-2be4e162-2971-47b1-b74a-7360adf3d34e service nova] Creating event network-changed:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:28:18.100003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-b7e0a7e9-ac6c-46b8-abc8-3694261df43f req-2be4e162-2971-47b1-b74a-7360adf3d34e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029771 Feb 12 04:28:18.100584 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 485/998] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:28:18.107234 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:28:18.441965 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-1d6caf40-e02f-46b8-b049-591fad077829 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "DELETE /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 204 len: 0 microversion: 2.1 time: 0.374151 Feb 12 04:28:18.445768 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 514/999] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:28:18 2022] DELETE /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:28:18.451662 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:18.454420 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:28:18.459201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:18.459644 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:18.460428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:18.460849 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:18.678163 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:28:18.686005 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-64dea2bf-57d1-46dd-ad75-da3bc97c20db tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1568 microversion: 2.1 time: 0.238236 Feb 12 04:28:18.686573 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 486/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:28:18 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:28:19.704045 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:19.705244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:28:19.711391 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:19.711839 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:19.713151 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:19.713622 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:19.853082 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:28:19.860561 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c823d008-f33c-4077-b4f6-f122c120d450 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1450 microversion: 2.1 time: 0.160801 Feb 12 04:28:19.861393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 515/1001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:28:19 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:28:20.654368 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-7f97d21d-31f7-441a-94cd-3aa8dc7f723c req-3f886e1e-490d-4308-8f12-8c9a514425cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e1a591-62ac-44cc-a194-fd476f478672", "name": "network-vif-deleted", "tag": "d27ab58c-67e5-4b39-a25a-65327b149fa3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:28:20.655927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:28:20.655927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:28:20.663239 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-7f97d21d-31f7-441a-94cd-3aa8dc7f723c req-3f886e1e-490d-4308-8f12-8c9a514425cd service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:20.666557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-7f97d21d-31f7-441a-94cd-3aa8dc7f723c req-3f886e1e-490d-4308-8f12-8c9a514425cd service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:20.674721 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-7f97d21d-31f7-441a-94cd-3aa8dc7f723c req-3f886e1e-490d-4308-8f12-8c9a514425cd service nova] Creating event network-vif-deleted:d27ab58c-67e5-4b39-a25a-65327b149fa3 for instance 69e1a591-62ac-44cc-a194-fd476f478672 on hv-cinder-82869 Feb 12 04:28:20.679599 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-7f97d21d-31f7-441a-94cd-3aa8dc7f723c req-3f886e1e-490d-4308-8f12-8c9a514425cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028865 Feb 12 04:28:20.680172 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 487/1002] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 04:28:20.877933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:20.878563 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:28:20.884676 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:20.885122 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:20.885933 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:20.886368 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:20.946824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489271f8dc5a432792bea8521abf5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9562939d04a04f868c738263f2375b8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:28:20.954959 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4e3eaf2a-a155-4f0c-b743-fab76d53f460 tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 200 len: 1220 microversion: 2.1 time: 0.080807 Feb 12 04:28:20.955769 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 516/1003] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:28:20 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:28:21.119735 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:28:21.119916 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:28:21.973231 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:21.973980 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] [instance: 69e1a591-62ac-44cc-a194-fd476f478672] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:28:21.980816 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:21.981299 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:21.982110 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:28:21.982537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:28:21.996848 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] HTTP exception thrown: Instance 69e1a591-62ac-44cc-a194-fd476f478672 could not be found. Feb 12 04:28:22.002590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Returning 404 to user: Instance 69e1a591-62ac-44cc-a194-fd476f478672 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:28:22.002590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-53e59376-d48a-4042-b437-b9f5c7ecdcea tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672" status: 404 len: 111 microversion: 2.1 time: 0.030299 Feb 12 04:28:22.002590 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 488/1004] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:28:21 2022] GET /compute/v2.1/servers/69e1a591-62ac-44cc-a194-fd476f478672 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:28:22.212509 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d06c5b26-1675-4cc0-8c9e-54230477f20a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] Calling method '.version_select at 0x7f8e6844edc0>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:28:22.283407 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d06c5b26-1675-4cc0-8c9e-54230477f20a tempest-TestShelveInstance-1371563056 tempest-TestShelveInstance-1371563056-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1487177663" status: 202 len: 0 microversion: 2.1 time: 0.074531 Feb 12 04:28:22.284065 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 517/1005] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 04:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1487177663 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:28:57.155686 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:28:57.156208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:29:44.317635 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5bac7ee1-0bf2-43a6-a9fe-0a3c0872784b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 12 04:29:44.321301 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:44.321783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:44.328309 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:44.328750 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:44.329557 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:44.329987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:44.353446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:29:44.663959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2b27f85a-c82f-46b1-985e-469f2c9b86b7 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "DELETE /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 204 len: 0 microversion: 2.1 time: 0.347830 Feb 12 04:29:44.664536 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 489/1006] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:29:44 2022] DELETE /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:29:44.670524 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a2c024b-9aa9-4836-90a8-c0c26fb43b07] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 04:29:44.674312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:44.675633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:44.684412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:44.684856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:44.685665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:44.686101 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:45.005146 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:45.012330 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-05dadc67-0754-48ec-b973-a56f11246698 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1579 microversion: 2.1 time: 0.343555 Feb 12 04:29:45.012879 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 518/1007] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:44 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1579 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:46.030775 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:46.031484 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:46.038917 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:46.039396 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:46.040186 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:46.040630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:46.055769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] [5bac7ee1-0bf2-43a6-a9fe-0a3c0872784b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 58010. Feb 12 04:29:46.228501 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:46.235779 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-33ceec4d-f5e8-4bd9-80e3-68a4fe2ff7b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1579 microversion: 2.1 time: 0.209588 Feb 12 04:29:46.236337 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 490/1008] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:46 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1579 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:47.252690 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:47.253899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:47.264419 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a2c024b-9aa9-4836-90a8-c0c26fb43b07] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 58018. Feb 12 04:29:47.271456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:47.271456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:47.271456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:47.271877 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:47.318466 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-97a23950-1459-40d2-9cfb-0695800aaa2a req-e827ceff-70ae-48ff-ae5c-57d5d079b8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198199d7-484a-4902-a98d-a9f3a79cfa95", "name": "network-vif-deleted", "tag": "920df1a9-8872-4cc9-9d62-d0101c526425"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:29:47.320724 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:29:47.320724 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:29:47.330475 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-97a23950-1459-40d2-9cfb-0695800aaa2a req-e827ceff-70ae-48ff-ae5c-57d5d079b8bf service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:47.331120 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-97a23950-1459-40d2-9cfb-0695800aaa2a req-e827ceff-70ae-48ff-ae5c-57d5d079b8bf service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:47.347116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-97a23950-1459-40d2-9cfb-0695800aaa2a req-e827ceff-70ae-48ff-ae5c-57d5d079b8bf service nova] Creating event network-vif-deleted:920df1a9-8872-4cc9-9d62-d0101c526425 for instance 198199d7-484a-4902-a98d-a9f3a79cfa95 on hv-cinder-82869 Feb 12 04:29:47.352306 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-97a23950-1459-40d2-9cfb-0695800aaa2a req-e827ceff-70ae-48ff-ae5c-57d5d079b8bf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099963 Feb 12 04:29:47.353826 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 491/1009] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:29:47.356672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:47.367875 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a7f78e72-6a53-4e56-b4c1-d8289e1b2d9e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1511 microversion: 2.1 time: 0.119720 Feb 12 04:29:47.368711 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 519/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:47 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:48.385790 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:48.389613 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:48.393555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:48.394037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:48.394823 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:48.395259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:48.426412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:48.426863 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:48.427353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lazy-loading 'fault' on Instance uuid 198199d7-484a-4902-a98d-a9f3a79cfa95 {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:29:48.468113 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:48.475743 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-001e14d5-a575-4c94-bde4-e6f39ce00917 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 200 len: 1231 microversion: 2.1 time: 0.094779 Feb 12 04:29:48.476508 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 492/1011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:48 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:49.492714 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:49.493345 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:49.499787 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:49.500238 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:49.501022 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:49.501488 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:49.513952 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] HTTP exception thrown: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. Feb 12 04:29:49.514540 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Returning 404 to user: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:29:49.515346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e66eebbd-9e80-4237-ba41-a376b5765340 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 404 len: 111 microversion: 2.1 time: 0.026426 Feb 12 04:29:49.515855 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 520/1012] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:49 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:29:49.615785 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-815604380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2112910915", "security_groups": [{"name": "tempest-secgroup-smoke-1955171707"}], "block_device_mapping_v2": [{"uuid": "3909722c-182d-4aec-9ece-6252aefaaff4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f30c43-2deb-4a40-8f2e-dea98a37ce35"}]}} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:29:49.720497 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.network.neutron [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] validate_networks() for [('73f30c43-2deb-4a40-8f2e-dea98a37ce35', None, None, None, None, None)] {{(pid=116750) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:29:50.388676 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:29:50.389742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image limits 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:29:50.390217 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:29:50.390624 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image pref 0:0:0 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:29:50.391031 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.virt.hardware [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116750) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:29:50.399580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:50.400022 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:50.400825 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:50.401259 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:50.416812 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:29:50.420679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.quota [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for user cfe451f65ec449499a947853f550e08a and project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116750) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:29:50.473965 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Going to run 1 instances... {{(pid=116750) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:29:50.476086 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3909722c-182d-4aec-9ece-6252aefaaff4',volume_size=None,volume_type=None)] {{(pid=116750) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:29:50.910903 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-ffad2cb1-f490-420b-9793-1fa376f0c7f0 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.298986 Feb 12 04:29:50.911591 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 493/1013] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:29:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:29:50.921957 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c2ce948b-c49a-40fc-bf63-911714a4237e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:50.922573 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c2ce948b-c49a-40fc-bf63-911714a4237e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:50.973680 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c2ce948b-c49a-40fc-bf63-911714a4237e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:50.980031 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c2ce948b-c49a-40fc-bf63-911714a4237e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1094 microversion: 2.1 time: 0.062414 Feb 12 04:29:50.980580 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 521/1014] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:50 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:52.000247 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:52.000855 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:52.006812 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:52.007252 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:52.008016 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:52.008449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:52.082512 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:52.089783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-43122cd2-79fb-4aa2-805a-436687651168 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1144 microversion: 2.1 time: 0.095997 Feb 12 04:29:52.090381 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 494/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:51 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:53.107321 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:53.111433 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:53.115925 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:53.116377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:53.117154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:53.117662 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:53.187913 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:53.195364 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-3766f4d0-2a57-44e6-805d-f248cd1065cd tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1210 microversion: 2.1 time: 0.091983 Feb 12 04:29:53.195911 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 522/1016] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:53 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:54.221715 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:54.222336 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:54.228797 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:54.229242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:54.230048 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:54.230482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:54.461993 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:54.470617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-2f88da30-1b8b-4dcd-af12-dd7f8411b85b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1278 microversion: 2.1 time: 0.253196 Feb 12 04:29:54.471442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 495/1017] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:54 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:54.703194 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-dc5f8edb-af38-4776-a421-42e17695fe55 req-bf5bc285-9367-4ea2-83d3-3de0b751dce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63", "tag": "e3ab8f5c-ac38-4993-bf4f-3485ffb322b3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:29:54.705395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:29:54.705395 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:29:54.713609 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-dc5f8edb-af38-4776-a421-42e17695fe55 req-bf5bc285-9367-4ea2-83d3-3de0b751dce5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:54.714055 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-dc5f8edb-af38-4776-a421-42e17695fe55 req-bf5bc285-9367-4ea2-83d3-3de0b751dce5 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:54.726365 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-dc5f8edb-af38-4776-a421-42e17695fe55 req-bf5bc285-9367-4ea2-83d3-3de0b751dce5 service nova] Creating event network-changed:e3ab8f5c-ac38-4993-bf4f-3485ffb322b3 for instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 on hv-cinder-82869 Feb 12 04:29:54.731126 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-dc5f8edb-af38-4776-a421-42e17695fe55 req-bf5bc285-9367-4ea2-83d3-3de0b751dce5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Feb 12 04:29:54.731776 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 523/1018] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:29:55.487445 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:55.488056 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:55.494512 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:55.494959 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:55.495742 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:55.496178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:55.626919 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:55.634154 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-4e11ceb7-3c29-42c5-a870-a3d7ec284b4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.150539 Feb 12 04:29:55.634714 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 496/1019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:55 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:56.652449 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:56.653131 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:56.660193 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:56.660636 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:56.661441 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:56.661871 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:56.794362 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:56.802327 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-14257363-91a2-4563-b69b-39530d0128b6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.154260 Feb 12 04:29:56.802978 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 524/1020] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:56 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:29:57.818679 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:57.819397 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:57.825773 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:57.826222 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:57.826992 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:57.827425 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:57.971999 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:57.979327 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-226d6605-20b7-450a-8a06-919d507b8f91 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.164469 Feb 12 04:29:57.979886 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 497/1021] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:57 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:29:58.995672 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:29:58.996283 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:29:59.003209 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:59.003660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:59.004442 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:29:59.004881 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:29:59.133099 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:29:59.140987 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c8d75b4e-31c2-4373-b2c7-afd8ea1701ef tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.148956 Feb 12 04:29:59.141590 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 525/1022] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:29:58 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:00.158170 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:00.158763 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:00.165068 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:00.165545 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:00.166325 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:00.166758 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:00.304298 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:00.311524 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-27d10da9-6598-4383-b310-4d3141cbe317 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.157674 Feb 12 04:30:00.312074 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 498/1023] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:00 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:01.328448 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:01.329055 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:01.335439 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:01.335890 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:01.336674 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:01.337112 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:01.469787 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:01.477204 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-e80aefe8-b18c-4122-bcf7-15db9c739b01 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.153067 Feb 12 04:30:01.477798 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 526/1024] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:01 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:02.494096 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:02.494731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:02.500977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:02.501463 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:02.502234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:02.502674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:02.633500 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:02.641145 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-62cbc590-1c68-42cc-81ff-58b5cbedb4e9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.150679 Feb 12 04:30:02.641730 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 499/1025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:02 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:03.658081 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:03.658681 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:03.665069 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:03.665550 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:03.666329 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:03.666761 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:03.799934 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:03.807156 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-4b78360a-8e97-4a2d-b95e-356ac5fcf360 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.153269 Feb 12 04:30:03.807709 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 527/1026] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:03 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:04.823589 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:04.824198 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:04.831088 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:04.831537 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:04.832316 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:04.832801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:04.961264 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:04.969019 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-de7b9f37-92c9-4b14-9b64-fcda23c32732 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.149139 Feb 12 04:30:04.969604 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 500/1027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:04 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 04:30:05.728531 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-72c0a9ad-f235-417f-8761-523600df3cbd req-263fa200-6b1c-4365-a500-4b3771c96ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63", "name": "network-vif-plugged", "status": "completed", "tag": "e3ab8f5c-ac38-4993-bf4f-3485ffb322b3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:30:05.730158 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:30:05.730158 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:30:05.737522 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-72c0a9ad-f235-417f-8761-523600df3cbd req-263fa200-6b1c-4365-a500-4b3771c96ce2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:05.737973 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-72c0a9ad-f235-417f-8761-523600df3cbd req-263fa200-6b1c-4365-a500-4b3771c96ce2 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:05.749745 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-72c0a9ad-f235-417f-8761-523600df3cbd req-263fa200-6b1c-4365-a500-4b3771c96ce2 service nova] Creating event network-vif-plugged:e3ab8f5c-ac38-4993-bf4f-3485ffb322b3 for instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 on hv-cinder-82869 Feb 12 04:30:05.754697 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-72c0a9ad-f235-417f-8761-523600df3cbd req-263fa200-6b1c-4365-a500-4b3771c96ce2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086516 Feb 12 04:30:05.755543 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 528/1028] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:30:05.985814 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:05.986444 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:05.992942 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:05.993416 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:05.994178 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:05.994606 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:06.194009 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:06.201412 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cbe4c2a9-4684-4f49-a8c9-4b610fbab24f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.219950 Feb 12 04:30:06.201978 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 501/1029] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:05 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:07.218456 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:07.219153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:07.225142 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:07.226758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:07.226758 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:07.226986 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:07.364557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:07.374558 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-43e066d9-64b6-4b40-b42a-d2f241980a8d tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1266 microversion: 2.1 time: 0.160640 Feb 12 04:30:07.375720 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 529/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:07 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:08.392477 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:08.393082 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:08.399485 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:08.399927 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:08.400707 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:08.401140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:08.534319 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:08.541793 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cfdaf21a-a5db-4956-9406-6b6c3b5acb82 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1454 microversion: 2.1 time: 0.153617 Feb 12 04:30:08.542347 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 502/1031] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:08 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:08.557808 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:30:08.558422 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:30:08.565486 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:08.566011 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:08.566893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:08.567397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:08.718565 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:30:08.726396 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-2d8bdef1-8afe-4258-a2d6-979218241b18 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1454 microversion: 2.1 time: 0.172196 Feb 12 04:30:08.726956 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 530/1032] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:30:08 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:30:11.177593 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-f4e0c167-89fb-4ce9-ae9d-94705996464f req-55dd49f6-3f28-46a3-ae2b-cb8c113e98d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63", "tag": "e3ab8f5c-ac38-4993-bf4f-3485ffb322b3"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:30:11.179735 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:30:11.179735 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:30:11.187449 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-f4e0c167-89fb-4ce9-ae9d-94705996464f req-55dd49f6-3f28-46a3-ae2b-cb8c113e98d9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:30:11.187878 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-f4e0c167-89fb-4ce9-ae9d-94705996464f req-55dd49f6-3f28-46a3-ae2b-cb8c113e98d9 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:30:11.198708 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-f4e0c167-89fb-4ce9-ae9d-94705996464f req-55dd49f6-3f28-46a3-ae2b-cb8c113e98d9 service nova] Creating event network-changed:e3ab8f5c-ac38-4993-bf4f-3485ffb322b3 for instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 on hv-cinder-82869 Feb 12 04:30:11.204366 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-f4e0c167-89fb-4ce9-ae9d-94705996464f req-55dd49f6-3f28-46a3-ae2b-cb8c113e98d9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030371 Feb 12 04:30:11.205137 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 503/1033] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:30:36.814377 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:30:36.814899 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:31:41.127673 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:31:41.128244 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:31:51.657833 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1548314340", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2112910915", "security_groups": [{"name": "tempest-secgroup-smoke-1955171707"}], "block_device_mapping_v2": [{"uuid": "9d43b57c-e10e-4024-b6fe-173fda9d4d1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73f30c43-2deb-4a40-8f2e-dea98a37ce35"}]}} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:31:51.764015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.network.neutron [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] validate_networks() for [('73f30c43-2deb-4a40-8f2e-dea98a37ce35', None, None, None, None, None)] {{(pid=116751) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 04:31:52.211130 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 04:31:52.211547 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image limits 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 04:31:52.212012 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Flavor pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 04:31:52.212412 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Image pref 0:0:0 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 04:31:52.212824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.virt.hardware [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 04:31:52.221191 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:52.221660 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:52.222454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:52.222884 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:52.238856 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 04:31:52.242902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.quota [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Getting quotas for user cfe451f65ec449499a947853f550e08a and project 1092010e5d02415b9ba03f62ba4ffe10. Resources: {'cores', 'ram', 'instances'} {{(pid=116751) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 04:31:52.298196 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Going to run 1 instances... {{(pid=116751) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 04:31:52.302274 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d43b57c-e10e-4024-b6fe-173fda9d4d1b',volume_size=None,volume_type=None)] {{(pid=116751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 04:31:52.734087 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-897d93f7-f63f-41b5-9ee8-b8aa5168a99b tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.081491 Feb 12 04:31:52.735013 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 531/1034] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 04:31:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 04:31:52.746442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-6920af42-e69e-4b1e-9f99-15f7e7072000 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:52.747267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-6920af42-e69e-4b1e-9f99-15f7e7072000 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:52.804286 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-6920af42-e69e-4b1e-9f99-15f7e7072000 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:52.811039 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-6920af42-e69e-4b1e-9f99-15f7e7072000 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1095 microversion: 2.1 time: 0.069906 Feb 12 04:31:52.811598 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 504/1035] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:52 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:53.828439 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:53.829036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:53.834934 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:53.835385 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:53.836165 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:53.836633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:53.895175 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:53.902352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-c413749e-ed61-4a79-a53f-e355f97d7e60 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1137 microversion: 2.1 time: 0.078574 Feb 12 04:31:53.903006 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 532/1036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:53 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1137 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:54.920561 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:54.921201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:54.927783 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:54.928234 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:54.929014 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:54.929595 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:55.007158 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:55.015266 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-c3a4be0c-6327-4d6a-b6ad-956acb71ba04 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1211 microversion: 2.1 time: 0.099017 Feb 12 04:31:55.016037 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 505/1037] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:54 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:56.035708 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:56.036322 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:56.042557 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:56.043005 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:56.044282 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:56.044715 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:56.153636 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-3b0b6728-8acb-4d38-85de-9b5ebb0a0d28 req-7a2b4297-9fef-43d2-984e-ff13969ec1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc3c99f-087b-4ae4-bd1f-acf01a6523cb", "tag": "de5f174b-cc91-4963-a16d-0b7ede372fb2"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:31:56.156089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:31:56.156089 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:31:56.164415 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-3b0b6728-8acb-4d38-85de-9b5ebb0a0d28 req-7a2b4297-9fef-43d2-984e-ff13969ec1ed service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:56.170269 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-3b0b6728-8acb-4d38-85de-9b5ebb0a0d28 req-7a2b4297-9fef-43d2-984e-ff13969ec1ed service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:56.177072 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-3b0b6728-8acb-4d38-85de-9b5ebb0a0d28 req-7a2b4297-9fef-43d2-984e-ff13969ec1ed service nova] Creating event network-changed:de5f174b-cc91-4963-a16d-0b7ede372fb2 for instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb on hv-cinder-82869 Feb 12 04:31:56.182208 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-3b0b6728-8acb-4d38-85de-9b5ebb0a0d28 req-7a2b4297-9fef-43d2-984e-ff13969ec1ed service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033082 Feb 12 04:31:56.183267 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 506/1038] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:31:56.289728 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:56.298085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-fd2e518e-860f-440d-aa2c-bf54630f24d9 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.265992 Feb 12 04:31:56.298659 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 533/1039] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:56 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:57.316492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:57.317191 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:57.323188 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:57.323643 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:57.324406 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:57.324839 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:57.717975 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:57.725168 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-54abab2a-a6b3-433f-a6bb-a6d0cc35c225 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.413192 Feb 12 04:31:57.725752 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 507/1040] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:57 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:58.814802 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:58.815413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:58.821153 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:58.821633 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:58.822400 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:58.822838 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:58.958783 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:31:58.966015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-eb4d65a1-9528-4e50-87bc-9fc659c71d11 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.228182 Feb 12 04:31:58.966577 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 534/1041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:58 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:31:59.982353 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:31:59.983005 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:31:59.989197 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:59.989668 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:31:59.990698 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:31:59.991133 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:00.126003 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:00.133580 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7397d1fe-c4dd-4eab-a963-658b632a16a6 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.154936 Feb 12 04:32:00.134147 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 508/1042] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:31:59 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:01.154463 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:01.155072 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:01.161331 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:01.161781 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:01.162668 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:01.163105 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:01.309387 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:01.316729 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-d205bc25-80c0-4df0-b768-3615b686634f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.166514 Feb 12 04:32:01.317294 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 535/1043] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:01 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:02.333363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:02.333968 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:02.340831 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:02.341298 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:02.342067 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:02.342497 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:02.472575 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:02.479767 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-0ca2a963-ccbc-4c06-9b4b-55b240570ad4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.150188 Feb 12 04:32:02.480334 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 509/1044] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:02 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:03.497349 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:03.497883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:03.504154 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:03.504621 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:03.505410 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:03.505850 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:03.639084 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:03.646245 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a8ab8750-0110-4af2-b988-4a202b554778 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.153417 Feb 12 04:32:03.646794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 536/1045] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:03 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:04.662369 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:04.662973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:04.669143 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:04.669618 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:04.670389 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:04.670819 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:04.801317 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:04.808481 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-850b80c0-5bf3-492a-8201-d5b3009ea9e3 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.149781 Feb 12 04:32:04.809640 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 510/1046] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:04 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:05.825435 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:05.826083 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:05.832299 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:05.832747 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:05.833551 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:05.833989 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:05.967015 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:05.974156 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-ca2942d7-3542-4661-8bbd-bdf73f37ef5f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.152362 Feb 12 04:32:05.974706 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 537/1047] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:05 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:06.218639 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-07194c19-c09d-4bdb-95b6-19747079e45d req-8e312217-0fa9-4d7f-96f5-85882d33cce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc3c99f-087b-4ae4-bd1f-acf01a6523cb", "name": "network-vif-plugged", "status": "completed", "tag": "de5f174b-cc91-4963-a16d-0b7ede372fb2"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:32:06.220156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:32:06.220156 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:32:06.227150 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-07194c19-c09d-4bdb-95b6-19747079e45d req-8e312217-0fa9-4d7f-96f5-85882d33cce8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:06.227582 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-07194c19-c09d-4bdb-95b6-19747079e45d req-8e312217-0fa9-4d7f-96f5-85882d33cce8 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:06.238946 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-07194c19-c09d-4bdb-95b6-19747079e45d req-8e312217-0fa9-4d7f-96f5-85882d33cce8 service nova] Creating event network-vif-plugged:de5f174b-cc91-4963-a16d-0b7ede372fb2 for instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb on hv-cinder-82869 Feb 12 04:32:06.244213 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-07194c19-c09d-4bdb-95b6-19747079e45d req-8e312217-0fa9-4d7f-96f5-85882d33cce8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029840 Feb 12 04:32:06.244868 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 511/1048] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:32:06.991374 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:06.991945 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:06.998902 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:06.999346 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:07.000217 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:07.000657 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:07.134755 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:07.142534 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-8b24b146-a165-4290-82fc-66daf9809d7e tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1267 microversion: 2.1 time: 0.155181 Feb 12 04:32:07.143089 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 538/1049] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:06 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:08.160630 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:08.161351 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:08.167492 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:08.167949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:08.168727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:08.169173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:08.306129 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:08.313769 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-adab21bf-7cf6-4f2d-af80-ce27340296c4 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1454 microversion: 2.1 time: 0.157640 Feb 12 04:32:08.314329 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 512/1050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:08 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:08.329716 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:32:08.335522 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:32:08.336560 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:08.337007 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:08.337886 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:08.338317 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:08.476028 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:32:08.483893 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-900bb01b-56c8-44a7-8f71-10295a3e906c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1454 microversion: 2.1 time: 0.157910 Feb 12 04:32:08.484695 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 539/1051] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:32:08 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:32:10.387724 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-72c15dfd-dd40-4143-bb5c-8c98d0af074a req-125640ab-3c45-4506-94fd-ec60395791bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc3c99f-087b-4ae4-bd1f-acf01a6523cb", "tag": "de5f174b-cc91-4963-a16d-0b7ede372fb2"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:32:10.389227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:32:10.389227 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:32:10.396390 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-72c15dfd-dd40-4143-bb5c-8c98d0af074a req-125640ab-3c45-4506-94fd-ec60395791bc service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:32:10.396824 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-72c15dfd-dd40-4143-bb5c-8c98d0af074a req-125640ab-3c45-4506-94fd-ec60395791bc service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:32:10.407949 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-72c15dfd-dd40-4143-bb5c-8c98d0af074a req-125640ab-3c45-4506-94fd-ec60395791bc service nova] Creating event network-changed:de5f174b-cc91-4963-a16d-0b7ede372fb2 for instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb on hv-cinder-82869 Feb 12 04:32:10.413363 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-72c15dfd-dd40-4143-bb5c-8c98d0af074a req-125640ab-3c45-4506-94fd-ec60395791bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029164 Feb 12 04:32:10.418422 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 513/1052] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:32:17.163670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:32:17.164201 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:32:23.643105 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:32:23.643873 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:32:40.975947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:32:40.976516 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:33:39.422667 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:39.424780 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:39.437532 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:39.437982 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:39.438974 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:39.439411 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:39.464990 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Going to try to terminate instance {{(pid=116751) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:33:39.503988 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [req-aa70ee9d-f5d2-41f2-a53e-6152e74d6eef req-be9170b5-979c-487d-a901-69152d3c1107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc3c99f-087b-4ae4-bd1f-acf01a6523cb", "tag": "de5f174b-cc91-4963-a16d-0b7ede372fb2"}]} {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:33:39.505720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:39.505720 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: warnings.warn(msg) Feb 12 04:33:39.512674 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-aa70ee9d-f5d2-41f2-a53e-6152e74d6eef req-be9170b5-979c-487d-a901-69152d3c1107 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:39.513116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [req-aa70ee9d-f5d2-41f2-a53e-6152e74d6eef req-be9170b5-979c-487d-a901-69152d3c1107 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:39.523569 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.compute.server_external_events [req-aa70ee9d-f5d2-41f2-a53e-6152e74d6eef req-be9170b5-979c-487d-a901-69152d3c1107 service nova] Creating event network-changed:de5f174b-cc91-4963-a16d-0b7ede372fb2 for instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb on hv-cinder-82869 Feb 12 04:33:39.528727 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [req-aa70ee9d-f5d2-41f2-a53e-6152e74d6eef req-be9170b5-979c-487d-a901-69152d3c1107 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102588 Feb 12 04:33:39.529521 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 514/1053] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:33:39.835991 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-a7cfbb28-02d1-45eb-9bf7-d60d01459c7f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 204 len: 0 microversion: 2.1 time: 0.417642 Feb 12 04:33:39.836683 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 540/1054] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:33:39 2022] DELETE /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:33:39.845260 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:39.846804 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:39.853242 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:39.854043 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:39.855102 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:39.855754 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:40.117224 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:40.124207 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-a0d1c81d-aed5-4a36-a09a-988f91cb3e00 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1579 microversion: 2.1 time: 0.283025 Feb 12 04:33:40.124777 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 515/1055] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:39 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1579 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:41.142097 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:41.142819 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:41.150160 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:41.150614 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:41.151393 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:41.151824 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:41.289086 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:41.296462 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-5295bb55-b12c-4b2e-b361-780cace70a03 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1460 microversion: 2.1 time: 0.158474 Feb 12 04:33:41.297024 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 541/1056] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:41 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:42.314140 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:42.314916 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:42.321482 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:42.321932 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:42.322734 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:42.323165 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:42.412161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:42.420546 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-592dc5f1-d245-4dd4-bcd1-9af5ab0fa54c tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1392 microversion: 2.1 time: 0.110012 Feb 12 04:33:42.430076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-e0495603-b0b0-43e3-815f-b6aaf7e2813a req-2c46f117-f345-4d15-8085-c3ed0fee3648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc3c99f-087b-4ae4-bd1f-acf01a6523cb", "name": "network-vif-deleted", "tag": "de5f174b-cc91-4963-a16d-0b7ede372fb2"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:33:42.430076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:42.430076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:33:42.431090 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 516/1057] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:42 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1392 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:42.431792 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-e0495603-b0b0-43e3-815f-b6aaf7e2813a req-2c46f117-f345-4d15-8085-c3ed0fee3648 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:42.432233 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-e0495603-b0b0-43e3-815f-b6aaf7e2813a req-2c46f117-f345-4d15-8085-c3ed0fee3648 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:42.444653 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-e0495603-b0b0-43e3-815f-b6aaf7e2813a req-2c46f117-f345-4d15-8085-c3ed0fee3648 service nova] Creating event network-vif-deleted:de5f174b-cc91-4963-a16d-0b7ede372fb2 for instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb on hv-cinder-82869 Feb 12 04:33:42.449920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-e0495603-b0b0-43e3-815f-b6aaf7e2813a req-2c46f117-f345-4d15-8085-c3ed0fee3648 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Feb 12 04:33:42.450440 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 542/1058] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:33:43.437499 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:43.438139 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:43.444448 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:43.444891 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:43.445703 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:43.446135 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:43.477833 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:43.478284 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:43.478731 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.objects.instance [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lazy-loading 'fault' on Instance uuid 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb {{(pid=116750) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 04:33:43.518215 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:43.525607 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-cde7873a-c890-4479-b908-fb0cba822cba tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 200 len: 1231 microversion: 2.1 time: 0.091771 Feb 12 04:33:43.526167 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 517/1059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:43 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:44.556655 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:44.557312 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:44.563413 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:44.563858 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:44.564622 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:44.565053 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:44.578090 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] HTTP exception thrown: Instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb could not be found. Feb 12 04:33:44.578661 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Returning 404 to user: Instance 3dc3c99f-087b-4ae4-bd1f-acf01a6523cb could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:33:44.579454 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-980bf5ff-c3d1-4c75-a63b-4087d585525f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb" status: 404 len: 111 microversion: 2.1 time: 0.027387 Feb 12 04:33:44.579954 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 543/1060] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:44 2022] GET /compute/v2.1/servers/3dc3c99f-087b-4ae4-bd1f-acf01a6523cb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:33:47.887173 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:47.887671 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:47.889337 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-cc9b2435-0b5c-448a-8277-78aeaf5a51f3 req-ea7cce72-4694-4db2-a322-aa8b8a118f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63", "tag": "e3ab8f5c-ac38-4993-bf4f-3485ffb322b3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:33:47.891466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:47.891466 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:33:47.893922 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:47.894442 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:47.895297 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:47.895801 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:47.898639 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-cc9b2435-0b5c-448a-8277-78aeaf5a51f3 req-ea7cce72-4694-4db2-a322-aa8b8a118f7c service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:47.899093 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-cc9b2435-0b5c-448a-8277-78aeaf5a51f3 req-ea7cce72-4694-4db2-a322-aa8b8a118f7c service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:47.912262 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-cc9b2435-0b5c-448a-8277-78aeaf5a51f3 req-ea7cce72-4694-4db2-a322-aa8b8a118f7c service nova] Creating event network-changed:e3ab8f5c-ac38-4993-bf4f-3485ffb322b3 for instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 on hv-cinder-82869 Feb 12 04:33:47.917605 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-cc9b2435-0b5c-448a-8277-78aeaf5a51f3 req-ea7cce72-4694-4db2-a322-aa8b8a118f7c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031982 Feb 12 04:33:47.918211 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 544/1061] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:33:47.922161 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Going to try to terminate instance {{(pid=116750) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 04:33:48.228083 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-7fcba87a-a729-4f87-a6aa-da39acb7bc62 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 204 len: 0 microversion: 2.1 time: 0.344618 Feb 12 04:33:48.230700 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 518/1062] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:33:47 2022] DELETE /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 04:33:48.238091 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:48.238791 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:48.245611 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:48.246188 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:48.247324 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:48.247920 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:48.580276 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.policy [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116751) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:48.588666 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-32924a33-c2c6-421b-b87e-c11b97839197 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1579 microversion: 2.1 time: 0.355377 Feb 12 04:33:48.591880 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 545/1063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:48 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1579 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:49.605741 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:49.606446 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:49.612665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:49.613116 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:49.613961 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:49.614403 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:49.747099 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:49.754987 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-13f13daf-1790-45c4-b88c-7f5b19dd96a2 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1460 microversion: 2.1 time: 0.153373 Feb 12 04:33:49.755538 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 519/1064] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:49 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:50.499520 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [req-d3bf0043-416e-4330-acf8-5ae3284c839f req-5482e39d-8796-4f13-9532-ae9195cf27c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63", "name": "network-vif-deleted", "tag": "e3ab8f5c-ac38-4993-bf4f-3485ffb322b3"}]} {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 04:33:50.501085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:50.501085 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: warnings.warn(msg) Feb 12 04:33:50.508366 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d3bf0043-416e-4330-acf8-5ae3284c839f req-5482e39d-8796-4f13-9532-ae9195cf27c1 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:50.508811 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [req-d3bf0043-416e-4330-acf8-5ae3284c839f req-5482e39d-8796-4f13-9532-ae9195cf27c1 service nova] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:50.519771 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.compute.server_external_events [req-d3bf0043-416e-4330-acf8-5ae3284c839f req-5482e39d-8796-4f13-9532-ae9195cf27c1 service nova] Creating event network-vif-deleted:e3ab8f5c-ac38-4993-bf4f-3485ffb322b3 for instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 on hv-cinder-82869 Feb 12 04:33:50.524721 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [req-d3bf0043-416e-4330-acf8-5ae3284c839f req-5482e39d-8796-4f13-9532-ae9195cf27c1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028914 Feb 12 04:33:50.525296 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 546/1065] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 04:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 04:33:50.771878 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:50.772665 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:50.778977 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:50.779428 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:50.780233 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:50.780670 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:50.853813 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.policy [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfe451f65ec449499a947853f550e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1092010e5d02415b9ba03f62ba4ffe10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116750) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 04:33:50.861576 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-27af0a60-37c1-4142-a964-aa4f392aea4f tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 200 len: 1225 microversion: 2.1 time: 0.093509 Feb 12 04:33:50.866890 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 520/1066] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:50 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 04:33:51.880046 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:51.880739 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:51.886665 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:51.887122 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:51.887896 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:51.888334 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:51.901500 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] HTTP exception thrown: Instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 could not be found. Feb 12 04:33:51.902076 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Returning 404 to user: Instance 3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:33:51.902883 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-7ab44cb2-00f2-40f7-a7e0-ff0b69020086 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63" status: 404 len: 111 microversion: 2.1 time: 0.027378 Feb 12 04:33:51.903397 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 547/1067] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:51 2022] GET /compute/v2.1/servers/3ebc3acc-d56f-48c0-a3e1-d8c14e0d6d63 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:33:52.384220 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:52.384759 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.compute.api [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116750) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:52.390976 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:52.391478 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:52.392256 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:52.392694 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG oslo_concurrency.lockutils [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116750) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:52.405973 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.wsgi [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] HTTP exception thrown: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. Feb 12 04:33:52.406555 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Returning 404 to user: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. {{(pid=116750) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:33:52.407360 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-5ac07501-8cc2-4719-bce3-4d8af4ace244 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "DELETE /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 404 len: 111 microversion: 2.1 time: 0.026937 Feb 12 04:33:52.407880 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 521/1068] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 04:33:52 2022] DELETE /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:33:52.415631 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '>' {{(pid=116751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:52.416266 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.compute.api [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] [instance: 198199d7-484a-4902-a98d-a9f3a79cfa95] Fetching instance by UUID {{(pid=116751) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 04:33:52.422036 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:52.422515 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:52.423352 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 04:33:52.423794 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG oslo_concurrency.lockutils [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Lock "341d3641-d12d-47f5-8051-421ca6730917" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 04:33:52.436373 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.wsgi [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] HTTP exception thrown: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. Feb 12 04:33:52.436947 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: DEBUG nova.api.openstack.wsgi [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Returning 404 to user: Instance 198199d7-484a-4902-a98d-a9f3a79cfa95 could not be found. {{(pid=116751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 04:33:52.437786 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO nova.api.openstack.requestlog [None req-0111c283-9ba5-421b-99c2-0793b2544a16 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95" status: 404 len: 111 microversion: 2.1 time: 0.025797 Feb 12 04:33:52.438297 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: [pid: 116751|app: 0|req: 548/1069] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 04:33:52 2022] GET /compute/v2.1/servers/198199d7-484a-4902-a98d-a9f3a79cfa95 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 04:33:53.981491 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: DEBUG nova.api.openstack.wsgi [None req-e640beee-2957-45f5-957f-b98b549ce540 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] Calling method '.version_select at 0x7f8e683255e0>' {{(pid=116750) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 04:33:54.098409 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO nova.api.openstack.requestlog [None req-e640beee-2957-45f5-957f-b98b549ce540 tempest-TestVolumeBootPattern-61323349 tempest-TestVolumeBootPattern-61323349-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2112910915" status: 202 len: 0 microversion: 2.1 time: 0.120507 Feb 12 04:33:54.098983 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: [pid: 116750|app: 0|req: 522/1070] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 04:33:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2112910915 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 04:35:01.135982 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:35:01.136625 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:35:37.172075 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:35:37.172617 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:35:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:37:16.826587 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:37:16.827177 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:37:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:38:21.145749 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:38:21.146495 dv-cinder-828696-3-iscsi devstack@n-api.service[116751]: Sat Feb 12 04:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:38:57.180035 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:38:57.180551 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:38:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 04:39:03.654782 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 04:39:03.655474 dv-cinder-828696-3-iscsi devstack@n-api.service[116750]: Sat Feb 12 04:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!